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ABSTRACT 


In a practical robotic system, it is important to represent and plan sequences of 
operations and to be able to choose an efficient sequence from them for a specific 
task. During the generation and execution of task plans, different kinds of uncer- 
tainty may occur and erroneous states need to be handled to ensure the efficiency 
and reliability of the system. In this thesis, we demonstrate a novel approach to task 
representation, planning, and error recovery for robotic systems. Our approach to 
task planning is based on an AND/OR net representation, which is then mapped to 
a Petri net representation of all feasible geometric states and associated feasibility 
criteria for net transitions. Task decomposition of robotic assembly plans based on 
this representation is performed on the Petri net for robotic assembly tasks, and the 
inheritance of properties of liveness, safeness, and reversibility at all levels of de- 
composition are explored. This approach provides a framework for robust execution 
of tasks through the properties of traceability and viability. Uncertainty in robotic 
systems are modeled by local fuzzy variables, fuzzy marking variables, and global 
fuzzy variables which are incorporated in fuzzy Petri nets. Analysis of properties 
and reasoning about uncertainty are investigated using fuzzy reasoning structures 
built into the net. Two applications of fuzzy Petri nets, robot task sequence plan- 
ning and sensor-based error recovery, are explored. In the first application, the 
search space for feasible and complete task sequences with correct precedence rela- 
tionships is reduced via the use of global fuzzy variables in reasoning about subgoals. 
In the second application, sensory verification operations are modeled by mutually 
exclusive transitions to reason about local and global fuzzy variables on-line and 
automatically select a retry or an alternative error recovery sequence when errors 
occur. Task sequencing and task execution with error recovery capability for one 
and multiple soft components in robotic systems are investigated. 
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CHAPTER 1 
INTRODUCTION 


1.1 Motivation 

In a practical robotic system, it is important to represent and plan sequences 
of operations and to be able to choose an efficient sequence from them for a spe- 
cific task. The earliest planning methodologies emerged in the area of artificial 
intelligence where domain-independent planning techniques were developed. In a 
robotic system, a planning strategy oriented to the characteristics of the system 
is often more effective than techniques derived from domain independent methods. 
Conventional representation of a system model without constraints may result in a 
huge search space for system states and task sequences. During the execution of a 
planned task sequence, because of uncertainty associated with the robotic system, 
exceptional or erroneous states are often met and thus the sequence may fail. Many 
factors may lead to uncertainty, and different kinds of devices in the system, such as 
manipulators, sensors, task-oriented mechanisms, human-robot interfaces, and the 
working environment may bring incomplete, approximate, or random information. 
Because planning is based on the assumption of expected system states, the model 
of a system should also carry the capability to represent the fuzzy information and 
provide a robust mechanism to detect and recover from an erroneous state. 

Robots are used in many industrial applications including manufacturing, as- 
sembly, hazardous environments, undersea or space exploration [31] [59]. Feasibility, 
efficiency, and reliability requirements are necessary for these robotic systems. In as- 
sembly, material handling systems, or other manufacturing environments, we should 
know the following information: 

• The geometric descriptions of all components in the system and all feasible 


1 



2 


combinations of components which form groups during the execution of a task 
by the system — A system state is defined to be the set of all current geometric 
configurations of components or component groups at a given time point. A 
system substate is defined to be a subset of a system state. Any component or 
component group is an example of a system substate. 

• Each feasible operation which functions on a corresponding substate of this 
system — These feasible operations are the feasible geometric relationships 
among components and component groups in the system. For the current 
system state, several operations may be enabled. After a feasible operation is 
performed on the current state, a new state will be created and a new set of 
enabled operations will be available. 

• An initial system state and a final system state Sometimes, a set of im- 
portant intermediate system states, i.e., subgoals, are indicated to search all 
feasible sequences more efficiently. These states may be given by users so that 
a smaller number of feasible states are generated during the search process. 
Some constraints may be set by relating algorithms so that these subgoals are 
followed automatically. 

• The feasibility assumptions and the descriptions of the working environment 
— Some operations may be recoverable, i.e., these operations are reversible. 
Some operations are not recoverable. To plan all intermediate points for a fea- 
sible collision-avoidance path for a robot arm, we need to know the geometric 
descriptions of obstacles in the working environment. 

There are two methods to describe a robot task sequence. One method directly 
uses an operations sequence, which is either a symbolic description or a formal 
language description. In a symbolic description, a task sequence is equivalent to a 
string of symbols and each symbol represents a corresponding operation, while in a 



formal language description, the set of all feasible task sequences is a specific task 
language. Another method is to use a sequence of partially or completely ordered 
system states to represent a task sequence. Using this method, we may conceive the 
state changes in a task sequence as well as monitor the completeness of an assigned 
task. In this research, we combine these two methods together. Before we search 
feasible sequences for a task, we first give an efficient and compact representation 
for the system and all feasible operations. We propose a novel representation for the 
system states as well as the transition criteria from system substates to substates. 
This representation can be mapped to and directly use the theory of Petri nets[84, 
88, 89] and its applications in modeling and control of manufacturing systems[2]. A 
simulation tool[73, 74] is available to verify and simulate a sequence chosen from all 
feasible sequences, before this sequence is practically implemented. 

To handle the uncertainty in a robotic system and to represent the subgoals 
for a global task, we apply the knowledge of fuzzy sets to the representation of the 
system. To generate a complete representation for the system and to efficiently plan 
all feasible sequences, different kinds of uncertainty should be analyzed and classi- 
fied. An approach to fuzzy reasoning embedded into this upgraded representation 
is then used to compute enabled operations and reason about system states. This 
fuzzy representation can also reduce the search space for feasible task sequences by 
defining subgoals for crucial operations. 

1.2 Objective of the Research 

The objective of this research is to develop an approach to representation and 
planning with uncertainty for a general robot assembly or material handling system. 
In this research, error recovery with minimum effort in replanning and changing 
a system model is also investigated with the representation of fuzzy information. 
Representation and planning are based on the geometric descriptions of a robotic 
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system and its environment. The resulting correct sequences are the output of the 
task planner. This planner will be connected to the path planner, trajectory gen- 
erator, grasp planner, vision servo system, and other lower level planning systems. 
The connections and the coordination among these planners are controlled and su- 
pervised on-line by a coordination level. The Petri net representation provides a 
good interface between the planning level and the coordination level. 

The ability to represent and automatically find an alternative subsequence or 
a recovery sequence is very important for the efficiency and robustness of a robotic 
system. A robust planner should minimize the probability for replanning in case 
an error occurs. We propose a generalized representation which incorporates the 
geometric relationships and feasibility among objects or object groups, the subgoals 
which are necessary for a correct operations sequence, different error recovery strate- 
gies, and an efficient reasoning mechanism for uncertainty. Our fuzzy representation 
offers the following advantages when error recovery is needed. 

• It may be unnecessary for the system to re-analyze the system states such as 
the current state and the initial state or final state, and it may be unnecessary 
to replan a recovery sequence as well . 

• Choosing an alternative sequence can maximize the use of task sequences 
already generated. A local alternative recovery strategy makes the best use of 
identical machines. A global error recovery strategy reduces the probability 
for a system to return to the initial state, and increases the probability for the 
system to recover from errors and reach the final state. 

• For an object containing multiple components of which the properties ma> 
change, when an operation on some of these components causes errors, we 
need not discard other components while recovering to a previous state. 

In this research, we also want to analyze the properties of a system using our 
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representation. This becomes more important when we incorporate more lower level 
devices and operations into the higher level representation. The case is similar when 
fuzziness is introduced into the system model. Some of the important properties such 
as liveness, safeness, and reversibility are discussed. 

1.3 Approach 

During the course of this research, we generate a high level representation and 
then decompose it to lower levels. Task sequence planning and property analysis 
are done on different levels of decomposition. Fuzzy sets are then introduced into 
this representation, and fuzzy reasoning about uncertainty, planning for subgoals, 
and sensor-based error recovery are investigated. 

1.3.1 A High Level Representation 

The scenarios we use in this research may also be applied to other kinds of 
robotic systems. For example, in the scenario in which a robot moves a book on 
table A to table B, all operations involved in this scenario can be described as 
assembly , disassembly , or /ST(Internal State Transition) operations, the three basic 
operations in a generic assembly system which we will discuss. The representation 
and planning methods for assembly systems may also be used for this example. 

We define a subassembly in an assembly system as a feasible combination of 
several components. We define an assembly as a special subassembly which is a 
substate of the final state, and which does not appear in any intermediate state 
or the initial state. We define an object in a robotic system as either a single 
component, a subassembly, or an assembly. After investigating a generic robot 
assembly system, we conclude that all possible operations appearing during the 
time the system is in execution can be classified as three types of basic operations: 
assembly operations, disassembly operations, and 1ST operations. Generally, for 
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an assembly operation, there is more than one object as the precondition, and one 
object as the postcondition. For a disassembly operation, there is one object as the 
precondition and more than one object as the postcondition. For an 1ST operation, 
both precondition and postcondition contain one object. 

We first check all components in the system and try to find all feasible com- 
binations of components, and therefore all feasible objects are generated. This 
checking process may be performed by the computer via a use-machine interacting 
mode. A system geometric state representation will then be generated. Based on 
this representation and all feasible geometric relations among objects, an AND/OR 
net representation of the corresponding system will be generated. The generation 
of this net is based on the feasibility assumption for each transition in the net. If 
some transitions are shown to be infeasible in one direction, a directed AND/OR net 
can be used to model the system. A mapping algorithm is shown to transform an 
AND/OR net to an ordinary Petri net and a reachability tree of this net from the 
initial state to the final state may be created based on an existing algorithm[84, 89]. 
A data structure for searching all possible sequences and the shortest sequence is 
developed with AND/OR nets. 1-boundedness, safeness, liveness, and reversibility 
have been proven to be guaranteed for the Petri net mapped from an AND/OR net. 
The safeness and 1-boundedness of the Petri net mapped from a directed AND/OR 
net are also proven to be guaranteed. The following research is based on the repre- 
sentation using AND/OR nets and mapped Petri nets for the system. 

1.3.2 Hierarchical Planning Decomposition 

The Petri net mapped from an AND/OR net is called a Level 0 Petri Net(PNO). 
Each assembly transition in this net can be decomposed to a motion command and 
a grasp command. Each disassembly operation can be decomposed to an ungrasp 
command and a motion command. An 1ST operation is more problem-oriented and 
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we do not decompose it at this level. Therefore, some transitions in PN 0 may be 
replaced by a subsequence of transitions and a Level 1 Petri Net(PNl) is thus gen- 
erated. The properties of PNO, 1-boundedness, safeness, liveness, and reversibility, 
are shown to be inherited by PN 1. 

In PN 1 , we still have not included the lower level objects such as sensors. 
Each transition in the net, which corresponds to a specific operation in the robotic 
system, requires a plan to control the execution of subtasks. For example, before 
the robot performs a motion operation, i.e., to move from an initial point to a final 
point, a collision-avoidance path should be planned. Another example is that a 
grasp operation needs a grasp plan, i.e,, we should choose a collision-free initial 
grasp configuration and a final grasp configuration^ 70]. During the grasp operation, 
the robot must be safe in both the initial grasp configuration and the final grasp 
configuration. A collision-avoidance path is required for the robot to reach the final 
configuration. Also, the grasping should be stable during the transfer motion. The 
problem-oriented operation, 1ST operation, needs a corresponding plan. For motion 
operations, two different kinds of motions may be classified and the corresponding 
motions are different in the sense of methodologies of accomplishments. Therefore, 
in the next level of decomposition, each motion command is decomposed to a free- 
motion command and a fine-motion command. The properties of the resultant net 
are also verified to be 1 -bounded, safe, live, and reversible. 

At the next step of decomposition, we add plans as preconditions for all tran- 
sitions in the net and add sensors as preconditions for each sensor-based motion 
transition. The resulting net still holds the properties which the upper level net 
has. For each plan in the net, a strategy is investigated to develop some subnet for 
planning to replace this plan, i.e., how plans are generated, which resources are used 
for planning, how uncertainties are reduced before planning on-line, and whether 
there is any resource conflict during the planning process and the execution process. 
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If we can represent resource conflicts for task planning in a lower level net, a shortest 
sequence planned from the corresponding Petri net will be of the lowest probability 
of error occurring. 

1.3.3 Generalized Fuzzy Petri Nets 

Because of the necessity to represent and reason about uncertainty within a 
robotic system, we propose a definition of the generalized fuzzy Petri net with three 
types of fuzzy variables. This definition is used for the following research in planning 
under uncertainty and sensor-based error recovery for robotic systems. The theory 
of generalized fuzzy Petri nets can also be applied to other kinds of applications 
in artificial intelligence, knowledge based systems, and manufacturing. Fuzzy state 
representation and reasoning rules with fuzzy sets are also incorporated with fuzzy 
Petri nets. Property analysis for some basic cases of system models are performed. 

1.3.4 Planning for Subgoals 

A planning Petri net usually incorporates a great number of possible task 
sequences. When all possible sequences are generated, it still takes a lot of time to 
choose from them. Normally, these sequences guarantee the properties of feasibility 
because of the feasibility constraints of the representation. However, some important 
events or operations, which we will call as subgoals , should be included in each 
correct sequence and should satisfy the correct precedence relationship. We define 
a complete sequence as a sequence which contains all subgoals, i.e., all important 
events. We may require that all possible sequences searched from the Petri net satisfy 
the properties of feasibility, completeness, and have correct precedence relationships. 
Based on this requirement, we propose a prime number marking algorithm to map 
the ordinary Petri net we developed to a fuzzy Petri net with global fuzzy variables, 
so that a strong numerical constraint is satisfied during the search for sequences. 
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A set of fuzzy reasoning rules are proposed to select an enabled transition and 
to obtain the fuzzy values of tokens in the output places for this transition. We 
notice that the properties of some objects may change. Generally, the properties of 
an object can either be the size, such as radius, length, thickness, etc., or the shape, 
and other physical properties, or the processing and machining characteristics, of a 
component this object contains, or the parameters of the structure of this object, 
such as the distance or the geometric relationships among different components 
within this object. 

Before the process for searching sequences starts, all possible fuzzy values are 
generated and stored using the prime number marking algorithm. During the search 
process, if a partial sequence meets a fuzzy value which is not in the possible fuzzy 
value set, this partial sequence will be discarded and a theorem guarantees this 
deletion will not lose any correct sequences. If not discarded, all partial sequences 
continue their development until the complete sequences are generated. Through 
the implementation of the theorems developed for this research, we found that the 
set of correct sequences for an assembly system, where one or more components of 
which the properties may change, is a very small portion of all possible sequences. 
Therefore, both the storage for saving all these possible sequences and the selection 
time for choosing the optimal or near-optimal sequence from the set of correct 
sequences are reduced. 

1.3.5 Alternative Error Recovery 

During the execution of a selected sequence from the set of correct sequences, 
some unexpected errors may occur and the sequence is therefore unexecutable. This 
happens because all operations in a planned task sequence are expected to be success 
ful and the execution of any operation in a sequence is dependent on the successes 
of its previous operations. In particular, in a fuzzy Petri net representation of a 
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robotic system, all transitions which change the properties of objects are defined to 
be key transitions. The marking for each transition is defined as a weighting factor. 
All weighting factors for key transitions are expected values. Therefore, all fuzzy 
values for the output places of certain key transitions are also expected values. If 
at some time point, during the implementation of a task sequence, an error occurs, 
this error will be propagated throughout the net to the final state and it may be 
difficult to check where the error occurs. An error recovery strategy is especially 
important for key transitions. If we detect possible errors just after key transitions, 
an immediate mutually exclusive recovery procedure may be followed. 

Therefore, for a certain key transition, if we find the output of this transition is 
beyond a certain range, we may either retry it, or use a local alternative subsequence, 
or recover back to a previous state or the initial state. All the previous transitions 
are refired after the corresponding component is replaced, or the parameters of the 
structure of an object are changed. The selection among these three directions will 
depend on the local fuzzy value of the object. To retain the original representation 
of a fuzzy Petri net model for a system, we use a sensor-based error recovery strategy 
for all key transitions. After a key transition is fired, a sensor verification procedure 
is called to investigate the current state of an object. Then, depending on the sensed 
value, the sequence will either retry in the local range, or continue its execution, 
or automatically choose a local alternative subsequence to execute, or go back to 
a previous state and follow a global alternative sequence to execute. There is a 
limit on the number of retries of the local transition. We have developed a method 
which automatically decreases the fuzzy value of an object when the sensed value 
continues to stay in the range of retry. After a finite number of retries, if the fuzzy 
value is still not correct as expected, an alternative local error recovery sequence 
will be automatically followed. 




11 


1.4 Contributions 

The main contributions of this research are shown as follows. 

• We introduce an AND/OR net representation for robotic task sequence plan- 
ning. An algorithm is developed to map this AND/OR net representation to 
a Petri net. Property analysis is performed on the resulting Petri net. Data 
structures for searching all possible operations sequences and the shortest se- 
quence are proposed and implemented. A directed AND/OR net representa- 
tion is also developed. 

• Algorithms are developed to decompose the high level representation of task 
sequence planning for generic robotic systems. The inheritance of properties 
between different levels of decompositions are investigated based on proven 
theorems. Traceability and viability are shown with robust execution of tasks 
using this approach. 

• We propose a generalized definition of a fuzzy Petri net. This fuzzy Petri net is 
shown to represent and reason about uncertainty. Fuzzy state representation 
and fuzzy reasoning rules are defined for the net. Three types of fuzzy variables 
are discussed. Fuzzy sets are shown to be directly used with fuzzy Petri nets 
and fuzzy computations are used for reasoning. Basic cases of property analysis 
with fuzzy Petri nets are given. 

• Fuzzy Petri nets with global fuzzy variables are used for task sequence plan- 
ning. Algorithms for assigning global fuzzy variables to fuzzy Petri nets are 
proposed. Fuzzy transition rules for global fuzzy variables are given. Fuzzy 
reasoning for global tasks are shown to reduce the search space for all feasible, 
complete, and correctly ordered sequences. 
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• Fuzzy Petri nets with local and global fuzzy variables are used for sensor-based 
error recovery for task sequences. Mutually exclusive transitions are proposed 
for on-line selection for alternative enabled transitions. Deterministic and 
nondeterministic fuzzy Petri nets are discussed. Theorems of error recovery 
with fuzzy Petri nets and related algorithms are proposed. 

1.5 Thesis Outline 

In Chapter 2, we present a literature review of recent research in task planning, 
assembly planning, planning under uncertainty, and Petri nets with fuzzy data. A 
conclusion of this review relevant to our research is also given. 

Chapter 3 and Chapter 4 discuss the methodology of representation for robotic 
task sequences without the consideration of uncertainty. Section 3.2 deals with the 
AND/OR representation for robotic systems. An algorithm is shown to generate 
an AND/OR net from the descriptions of system geometric states. A mapping 
algorithm for transforming an AND/OR net to a Petri net is then given in Section 
3.3. 1-boundedness, safeness, liveness, and reversibility of the resulting Petri net are 
analyzed. In this section, a directed AND/OR net is also defined and the similar 
properties are analyzed. In Section 3.4, we present a data structure for searching 
all possible sequences and the shortest sequence from the AND/OR net. We give 
an example of task sequence planning using AND/OR nets in Section 3.5. 

Chapter 4 generalizes the results given in Chapter 3 and introduces a repre- 
sentation of a generic robotic assembly system by decomposing the higher level nets. 
Section 4.2 gives the definitions for a generic assembly system. Section 4.3 reviews 
the AND / OR net representation specially for assembly sequence planning. We then 
discuss the decomposition algorithms for Level 1 and Level 2 Petri nets and analyze 
the properties for resulting lower level nets in Sections 4.4 and 4.5. The conditions 
for the inheritance of properties are discussed. In Section 4.6, a robotic assembly 
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system modeled using the methods discussed above is simulated. Section 4.7 gives 

a conclusion about the shortest sequence. 

Chapter 5 is independent of the other chapters of the thesis, and develops a 
novel definition of a fuzzy Petri net(FPN). The results represented in this chapter can 
be used for other applications in artificial intelligence, knowledge-based systems, and 
manufacturing. The presentation of the following two chapters are based on Chapter 
5. Three types of fuzzy variables are proposed for different kinds of uncertainty 
modeled with fuzzy Petri nets. State representation and reasoning rules in the FPN 
are given in Sections 5.3 and 5.4, respectively. Property analysis is then given for 
different conditions of the FPN in Section 5.5. Two examples of the FPN with 
different kinds of variables are shown for task planning and robot sensing in the 

following two sections. 

Chapter 6 uses fuzzy Petri nets for robot task sequence planning. A detailed 
discussion on state representation for task sequences is given in Section 6.2. We 
show fuzzy sets for modeling system states in Section 6.3. An algorithm for assign- 
ing global fuzzy variables is then proposed in Section 6.4. Some theorems about 
using global fuzzy variables to search feasible sequences are also given. Section 6.5 
generalizes the results in Section 6.4 and a fuzzy representation for a system with 
more general characteristics is discussed. Simulation results, especially the compar- 
ison of the complexity for searching sequences with ordinary Petri nets, are given in 

Section 6.6. 

Chapter 7 is an application of FPNs for sensor-based error recovery for robotic 
task sequences. Some important definitions are given in Section 7.2. Section 7.3 
gives the fuzzy transition rules for global fuzzy variables. In Section 7.4, execution 
of plans on the fuzzy Petri net is discussed with the introduction of mutually exclu- 
sive transitions. Deterministic and nondeterministic fuzzy Petri nets are discussed 
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regarding different characteristics of local fuzzy variables. The issue of error recov- 
ery is presented in details in Section 7.5 for different cases. An algorithm for the 
execution of a task sequence with sensory verification and error recovery is shown. 
We prove the theorems regarding automatic error recovery. An algorithm for gener- 
ating an executable FPN is presented in 7.6, followed by the examples using different 

error recovery strategies in Section 7.7. 

Chapter 8 summarizes the presentation of original contributions in this thesis. 
Directions of future research based on the existing results are discussed. 



2.1 Introduction 


CHAPTER 2 
LITERATURE REVIEW 


In this chapter, we briefly review the work relating to our research and in- 
vestigate the relationships of these published results with our work. Our research 
was originated from a project on the integration of an automated garment handling 
system[9, 101, 102], which was supported by the Defense Logistics Agency. During 
the research on modeling, planning, and software integration on this project, we con- 
structed the AND/OR net modeling tool, and this methodology was then applied 
to the NASA/CIRSSE space robotic assembly project. The resulting approach to 
task decomposition, planning under uncertainty, fuzzy descriptions for objects, state 
identification and verification, and error detection and recovery, is based on Petri 
nets and fuzzy Petri nets. In this chapter, we review the literature on task planning 
and assembly planning, and then show some previous results on the representation 
of uncertainty for task planning. A concise review of the research efforts in Petri 
nets using fuzzy data is also included. 

2.2 Task Planning 

Research in robotic planning is closely related to some corresponding areas in 
artificial intelligence. Domain-independent planning methodologies have been de- 
veloped which can generate sequences of actions to change the initial world model 
and make it satisfy the final goal conditions. All possible actions in the sequences 
belong to a feasible set of operators which cause changes in the state of the system. 
The ability to reason about actions is a core problem to design a planning system. 
Domain-independent planners yield planning techniques that are applicable in many 
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domains with some modifications and provide a general planning capability. A re- 
view paper[43] describes the development of classical plan generation systems, the 
important problems that have arisen in the design of planning systems, and some 
solutions that have been developed in over 30 years of research in this area. Plan- 
ning research has identified many issues in the fields of AI including representation, 
reasoning, search, learning, sensation and perception, and distributed systems. A 
survey on the AI approach to robot planning is given in [76]. 

Besides the property of generality for domain-independent planning, a gen- 
eral planner should also provide representations and methods to include domain- 
specific knowledge and heuristics. A number of planning systems corresponding to 
this theme have been created, such as EMYCIN[77], NOAH[96], STRIPS[36, 37], 
MOLGEN[I03, 104], DEVISER[114], and SIPE[118]. These planners are designed 
for a general problem solving environment. Most of the input knowledge takes the 
form of predicate calculus formulas, and actions are given in the form of trans- 
formation rules. Problem solving using these planners requires the capability for 
representing, retrieving, and manipulating sets of statements. Thus, extensive com- 
puting power for searching and inference in order to solve a reasonably complex 
real-world problem is needed for AI planning. Recent systems have overcome some 
drawbacks of previous systems, however, current planning systems are still not ro- 
bust and efficient enough to operate in complex robot workcells. Therefore, in robot 
working environments, and particularly assembly workcells, domain-dependent plan- 
ning methods, though possibly lacking generality, are often more effective since they 
represent and reason about domain-related constraints directly. 

A task planner transforms the task-level specifications into manipulator level 
specifications. To carry out this transformation, the task planner must have a de- 
scription of the objects being manipulated, the task environment, the robot carrying 
out the task, the initial state of the environment, and the desired final goal. The 
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output of the task planner would be a robot program to achieve the desired final 
state when executed in the specified initial state. Robotic task planning may be 
divided into three phases: modeling, task specification, and manipulator program 
synthesis[70]. The modeling phase consists of the following information: geometric 
description of all objects including robots in the task environment, physical de- 
scriptions of all objects, kinematic descriptions of all linkages and descriptions of 
characteristic of moving objects such as robots. Task specification corresponds to 
sequences of states of the world model, where state is defined to be the configura- 
tions of all objects in the system. This is the goal of domain-independent planning 
research as well as domain-dependent planning. Our research shown in this the- 
sis will focus on planning the sequences of operations which change the geometric 
configurations of the system. The manipulation program synthesis stage is to map 
task plans to the corresponding manipulation program which is composed of motion 
commands, grasp commands, sensing commands, and commands for grasp planning, 
motion planning, etc. 

Generally, task planning in robotics requires precise models and knowledge 
about mechanical and geometric specifications. Research in motion planning, grasp 
planning, assembly planning, robot programming and teleprogramming, and sensor- 
based manipulation has yielded important results which are closely tied to the plan- 
ning problem. A portion of the research in task planning takes the form of robot 
programming languages which allow the descriptions of robot tasks as a high-level 
language such as AL[83], AML[108], AUTOPASS[66], and MAPLE[28]. Robot pro- 
gramming languages can be classified as joint or actuator level languages, manipula- 
tor or end-effector level languages, object-level languages, and task-level languages. 
Task-level languages, in particular, often require planning capabilities. The progress 
made in robot programming and task planning systems in the last twenty years and 
the current research trends are discussed in [33]. 
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2.3 Assembly Planning 

One branch of robotics planning research is robot assembly planning. Most 
published assembly planning contributions focus on the modeling of the assembly 
process, i.e., describing the geometric configurations of the assembly which is con- 
structed by single parts and the topological relations among the parts. Another 
direction in the research on assembly takes into account the factor of uncertainty, 
and therefore sensing operations, the alternative subsequence selection based on 
sensory information, sensory verification for uncertain states, and checking for error 
states as well as the generation of recovery sequences are combined into the planning 
process. We will review the literature in this area in the next section of this chapter. 

Bourjault’s[6] work on planning was based on an interactive algorithm using 
questions about the mating of two parts or multiple parts. The information Bour- 
jault used is a list of parts and a network of nodes(parts) and lmes(liaisons), where 
liaisons define the connection relationships among parts. Bourjault’s graph model is 
different from Jentsch and Kaden’s[55] connection graph model, where three types 
of touches between parts are expressed. All valid assembly sequences are gener- 
ated algorithmically from a series of rules, which are derived from the answers to 
the questions about matings among parts. However, Bourjault’s method requires 
2P{1 is the number of liaisons in the network) questions plus a number of subsequent 
questions whose existence usually depends on answers to part of the former question 
set. De Fazio and Whitney[29] modified the approach that Bourjault has developed 
to generate assembly sequences based on the answers to the conditions of liaison 
establishments, i.e., the precedence relationship for assembly tasks. The question 
set in their approach contains a smaller number of questions than that in Bourjault s 
set, and these questions usually obtain more involved answers. Thus, these ques- 
tions may cause direct relationships equivalent to those in Bourjault’s, and valid 
assembly sequences can be generated algorithmically directly from these equivalent 
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relationships. Compared with Bourjault’s method, the improved method requires 
21 questions that are answered in a precedence-logical form. Chen [25] transformed 
the precedence relations for assembling parts into a pattern-matching problem and 
the problem of generation of all possible assembly sequences is formulated as a state 
constrained traveling salesman problem. The concept of a pattern matching algo- 
rithm is to match liaisons or parts with one of the parts so that current last assembly 
operation is obtained. In Chen’s work, a mechanism of precedence knowledge acqui- 
sition is proposed which will reduce the time in obtaining such knowledge so that 
the time for generating sequences is also reduced. This approach results in only l 
questions to be answered. 

All the above methods to generate possible assembly sequences are based on a 
user-computer interactive mode. The user is requested to answer a lot of questions 
about the precedence relationships among the liaisons of parts and the correctness 
and the completeness [49] of the sequences of operations generated are not guaran- 
teed. Homem de Mello and Sanderson[45, 47] used the AND/OR graph to represent 
the decomposition process of an assembly based on the property of feasibility. There- 
fore, the problem of finding all possible assembly sequences is converted to find all 
feasible disassembly operations for an assembly or a subassembly until all subassem- 
blies or parts belong to the initial state. A compact representation of all feasible 
assembly sequences is then obtained and its correctness and completeness is shown 
in [49]. A complete comparison of AND/OR graph representation for assembly se- 
quences with other representations and mappings among these representations are 
discussed in [48]. Based on the work of AND/OR graph representation for assembly 
sequences, Homem de Mello and Sanderson proposed a heuristic search algorithm 
for the best sequence, which uses the criteria of maximizing the number of different 
sequences and minimizing the execution time through parallel execution of assembly 

tasks[50]. 
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Some researchers concentrated on the constraints among parts inside an as- 
sembly to generate all feasible assembly sequences. Morris and Haynes[82] took into 
account the geometric constraints during the design of a robot programming system. 
Their understanding of geometric constraints is based on the degrees of freedom of 
the parts being assembled. When parts are assembled, their degrees of freedom 
are reduced. Besides the degrees of freedom constraints, Thomas and Torras[109] 
also proposed two other types of constraints, i.e., shape-matching constraints and 
non-intersection constraints. These constraints are used to infer assembly configu- 
rations for a practical and efficient planner. Vijaykumar and Arbib[115] proposed 
a strategy to decompose a sequence of operations and also satisfy the constraints 
arising from task and object characteristics. The assembly operations and object 
level descriptions are refined to be feature level descriptions using object symme- 
tries, then spatial relationships, and at last commands to path planner and grasp 
planner. This work was actually not proposing an explicit method for planning but 
provided a connection between the high level planner, such as an assembly sequence 
planner, and the lower level planners such as a path planner and a grasp planner. 
As we will show later in Chapter 4, our decomposition for sequence plans is based 
on the decomposition of the representation of plans, which incorporates all possible 
sequences, rather than a specific task sequence. Therefore, during the decomposi- 
tion process, any conflict or constraints of resources will emerge level by level, so 
that the feasible sequences searched from the final representation of decomposition 

are guaranteed. 

Another example of using constraints for assembly is by Popplestone, Liu, and 
Weiss[92j. They used group theory to describe the symmetries of components in a 
computational form, so that a unified computational treatment of reasoning about 
how parts with multiple contacting features fit together is provided. Using this 
approach, when an object is assembled from several parts, the overall symmetry 
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can be obtained from the parts whose symmetries are already known. Moreover, a 
condition for features to mate is that they have the same symmetry group, so that 
the geometric feasibility may be tested by intersecting the constraints corresponding 
to each symmetry group of mating features. 

2.4 Planning Under Uncertainty 

Uncertainty may exist during planning generation and execution. Often uncer- 
tainty arises from run-time errors in sensing or control. Another cause of uncertainty 
may be one’s lack of knowledge of modeling a system or environment. Different ap- 
proaches have been proposed to solve the uncertainty problems in different robotics 
domains. Most efforts have been focused on compliant motion planning to deal with 
uncertainty[97, 105, 117]. Fine motion strategies are also synthesized in the presence 
of uncertainty [71]. Other related work is the characterization of manipulation tasks 
in terms of randomization[34] and entropy [98]. A preimage backchaining approach 
was used to address the problem of planning motion strategies in robot control and 

sensing in the presence of uncertainty [60]. 

When the robot planner generates a task sequence and forwards it to the 
robot program synthesizer to output an executable program, the robot manipulator 
will then implement this program to reach a desired final goal and also satisfy 
some constraints. However, some factors of uncertainty might show up during the 
execution of plans, and if no procedure is existing to verify, compute, and solve these 
uncertainties, the accumulations of the errors resulting from these uncertainties may 
cause a failure, and the sequence of tasks will not be finished. Brooks[7] described 
uncertainty for plan execution from three possible sources. The first source is the 
positional and repeatability uncertainty of the manipulator, which might be due 
to either stochastic or long-term drift effects. The latter case could be solved by 
calibration of the manipulator before each round of execution. The second source is 
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the objects to be manipulated, since each object or part has its toleranced dimensions 
during manufacturing. When a grasp planner generates a planning program, the 
numerical representations of parts play an important role, such as lengths, diameters, 
and angles. When the system consists of more parts, the problem of the possible 
errors for the representations may become more serious. Thirdly, if we assume 
the parts were not in the work environment originally, then the initial uncertainties 
should be taken into account for the introduction of these parts into the environment 

by human hands or a mechanical device. 

In our research, we propose an additional type of uncertainty, the uncertainty 
of the accomplishment of subgoals. A checking and verification procedure which may 
use sensing operations for the quality of the fulfillment of subgoals is investigated 
and an algorithm is proposed in Chapter 7. Using this method, we reduce the 
propagation of errors for subgoals to a range of tolerance so that the correctness of 

the final goal is guaranteed. 

In Kamel and Kaufmann’s[56] work, two more factors are considered for un- 
certainty, one is inaccurate or error-prone sensing information, and another is the 
dynamic working environment, which is outside the control of the manipulator. For 
the latter case, we could also use sensory verification procedures as we use in the 
verification for the fulfillment of subgoals. For inaccurate sensory data, because 
we would map it into a fuzzy value during the firing of a fuzzy reasoning rule, the 
tolerance of this mapping would reduce the possible inaccuracy of sensory operators. 

In Brook’s work[7], an explicit block of plan checker was discussed and this 
block was separate from the block of robot planner. Plan checker was introduced 
to infer the effects of actions and the propagation of errors. Brook’s major effort 
is to make a program that can automatically determine whether a plan generated 
by a robot planner is feasible, and when sensing information is obtained by the 
robot controller, the plan checker must have the ability to check and update plans 





23 


for computations which the robot controller will make. Comparing with Brook’s 
approach, our model of error detection and recovery is combined with the task 
planner. Procedures for dealing with uncertainties and errors do not influence the 
representation structure for planning, and also the recovery procedure would be 

automatically called or an alternative sequence followed. 

An example of a robot assembly planning system which handles uncertainties 
is Spar[51]. There is a three-level planning hierarchy for Spar, i.e., the operational 
level to handle high level operations, the geometric level to couple with geometric 
constraints, and the uncertainty-reduction level to deal with uncertainties and errors. 
In the lowest level, Spar uses its knowledge about the uncertainty in the world 
description to asses the possibility of run-time errors. To achieve this goal, Spar 
adds sensors to the plan to reduce uncertainties, and if uncertainty is too large, 
precompiled recovery plans would be added. Compared with Spar, the methodology 
for our research to decompose a representation of planning considers all possible 
operations in assembly, i.e., free motion, fine motion, grasp, and ungrasp. 

To handle the uncertainties in execution of plans, we should find a strategy 
to monitor the uncertainties and call an error recovery procedure to remedy any 
exceptional cases whenever uncertainties are too large to go on the execution of the 
normal sequences. A number of approaches to error recovery for assembly workcells 
have been discussed in the literature. A repair sequence generation algorithm was 
proposed for planning disassembly and repair using the AND/OR graph[46, 99]. In 
the approach described in [69], the task execution control function of a workcell 
controller is decomposed into three sub-functions which are performed by three 
software modules: failure detection, failure diagnosis and failure recovery. Using 
Petri nets to model the controller in an automated manufacturing system, four 
basic error recovery planning mechanisms to augment the controller are discussed in 
[35]: input conditioning, alternate path, backward error recovery, and forward error 
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recovery. Some important properties of the augmented controller are guaranteed to 
be preserved[123]. Other recent work on error recovery[32] has focussed on the local 
physical and geometric constraints related to manipulation tasks. 

2.5 Petri Nets with Fuzzy Data 

Since C. A. Petri presented his original idea[90], where he formulated the basis 
for a theory of communication between asynchronous components of a concurrent 
system, a rich body of knowledge concerning both the theoretical and applied do- 
mains of Petri nets has been developed. Petri nets have been widely used in modeling 
and analyzing flexible manufacturing systems[2, 3, 78, 85, 116, 125], discrete event 
systems[26, 58], computer systems[44, 75, 80, 94], knowledge-based systems[8][52], 
robot assembly systems[121], as well as other kinds of engineering applications. 
This is an efficient abstract and formal information flow model. The Petri net is 
characterized by its flexibility and efficiency in modeling and analysis of complex 
discrete-event systems. For an extensive survey and overview on Petri nets, refer 
to [84, 88, 89]. In a recent article[2], an overview of the Petri net approach to 
the modeling, analysis, design, and control of automated manufacturing systems is 
presented. 

The formal definition for Petri nets and related properties as well as the math- 
ematical operations on Petri nets are defined in [2, 84, 88, 89]. 

There are some examples of using Petri nets to model robotic or assembly 
processes so that a sequence of operations is generated based on the Petri net model. 
In [120], a plan generating tool for robotic applications using Predicate/Transition 
nets[39, 40] is described. This tool is based on modeling STRIPS-like rules by 
Pr/T nets and then the T-invariant method of the Pr/T nets is utilized to generate 
robot plans. However, this approach still stays in domain-independent formalism 
and the applications are limited to blocks world. Zhang[12l] described an approach 
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to representing simple specific assembly actions using a Petri net and presented an 
algorithm for automatic planning of an assembly robot based on the Petri net model 
of the assembly. There are several shortcomings in this approach and therefore this 
methodology is difficult to generalize. First, the process of constructing a Petri 
net model for the assembly is a bottleneck for the algorithm because no systematic 
method is proposed to derive topological relations among the parts. Second, the 
creation of places and transitions for the Petri net model is problem-specific so 
that it could not be generalized to other applications. Third, the algorithm only 
addresses the problem of finding one feasible sequence. The approach is not shown 
to be correct or complete. 

Some types of Petri nets with fuzzy data have been proposed to handle prob- 
lems in different applications. Looney[68] modified the usual Petri net to allow fuzzy 
rule-based reasoning by propositional logic. The resulting net is considered as a new 
type of neural network where the transitions serve as the neurons, and the places 
serve as the conditions, so that fuzzy reasoning for knowledge could be performed. 
Conditions may be conjuncted and disjuncted in a natural way to allow the firing of 
the neurons. Aside from the firing methods in usual Petri net models, in Looney s 
Petri net which implements logic implication, when a neuron is fired, the original 
token would remain at its precondition and copies would be sent out to all its post- 
conditions. One difference in this fuzzy net model from the usual fuzzy rule-based 
reasoning is in the representation of certainty or degree-of-belief values of the fuzzy 
rules. Chen, Ke, and Chang[24], however, eliminate this difference. In their work, a 
structured representation of production rules by fuzzy Petri nets, and a systematic 
procedure for supporting fuzzy reasoning, is proposed. Using this approach, each 
place represents a proposition. An algorithm is proposed to reason about the degree 
of truth of proposition dj, if a degree of truth of another proposition di is given in 
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the net. If no solution is obtained, then these two propositions have no antecedent- 
consequence relationship. Similar work was done by Garg, Ahson, and Gupta[38] 
where a fuzzy Petri net was used to represent knowledge and an algorithm was pro- 
posed for checking the consistency of a fuzzy knowledge base via a set of reduction 

rules that preserve the properties of the FPN. 

There are also other similar approaches in extending Petri nets in an impre- 
cise or fuzzy sense. Valette, Cardoso, and Dubois[112] introduced uncertainty and 
imprecision within Petri net based models for application to monitoring of manu- 
facturing systems. This approach is based on the association of a fuzzy value with 
the time delay for execution of a transition, which results in attaching a fuzzy date 
to the transition. The marking of Petri nets with objects and their interpretation 
were also introduced in their work[23]. Based on these assumptions, the relations 
between Petri nets and logic, the necessity to use Petri nets with objects to repre- 
sent uncertainty, and the implementation of Petri nets as rules, were discussed in 
[113]. In Tsuji and Matsumoto’s work[110], an extended Petri net was proposed to 
model the vague conditions, and the boundedness, liveness, and reachability for this 
model of fuzzy inference engines were analyzed. Another kind of approach modeled 
production systems where a numerical Petri net model was proposed[67] and the 
correctness, consistency, and completeness of the knowledge base were verified. 

2.6 Conclusion of Literature Reviews 

In this chapter, we review work on task planning, assembly planning, planning 
under uncertainty, and Petri nets with fuzzy data. To author’s best knowledge, there 
is no previous work that used fuzzy logic to describe constraints and uncertainty in 
task planning and no work that applies ordinary or fuzzy Petri nets to task sequence 
planning, task decomposition, and evaluation and analysis of robotic systems. Prior 
work has emphasized that uncertainty is very important during both planning and 
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execution. Using uncertainty for planning, we add sensors to check and verify the 
uncertain state of the system, while using uncertainty in execution, we are required 
to call error recovery procedures to remedy exceptional cases should errors occur. 




CHAPTER 3 

AND/OR NET REPRESENTATION FOR ROBOTIC TASK 
SEQUENCE PLANNING 

This chapter describes an approach to task sequence planning for a generalized 
robotic workcell. Given the descriptions of the objects in this system and all fea- 
sible geometric relationships among these objects, an AND/OR net represents the 
relationships of all feasible geometric states and associated feasibility criteria for net 
transitions. This AND/OR net is mapped into a Petri net which incorporates all 
feasible sequences of operations. The resulting Petri net is shown to be 1-bounded 
and have guaranteed properties of liveness, safeness, and reversibility. Sequences are 
found from the AND/OR net or the reachability tree of the Petri net. Feasibility 
criteria for net transitions may be used to generate an extended Petri net repre- 
sentation of lower level command sequences. The resulting Petri net representation 
may be used for on-line scheduling and control of the system. 

3.1 Introduction 

Most applications of robotic systems require the generation of a task plan 
which specifies the sequence of operations which must be carried out in order to 
achieve a stated goal. The generation of this task plan has been approached from 
several different perspectives, but in general some set of operations , or actions, and 
associated pre-conditions and post-conditions axe defined. The representation of 
actions and conditions(states) defines the universe of the planning task. Exploring 
the feasible sequences of actions which satisfy pre- and post-conditions defines a 
search problem which must be solved to identify a feasible, and perhaps optimal, 
sequence. 

Research on domain-independent planners[36, 37, 77, 96, 118] explored generic 
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representation and search strategies which yield feasible sequences. Much of this 
work has focused on state representation by propositional logic(well-formed for- 
mulae). Single-level and hierarchical representation and search have played an 
important role. Strictly sequential search(linear planning) versus non-sequential 
search(non-linear planning) have also been extensively described. 

In robotic systems, a propositional logic state representation often does not 
capture the geometric relations required to fully describe the system state. Ap- 
proaches to task planning and task-level languages for robotic systems have therefore 
concentrated on model-based descriptions of objects, configurations, and geometries 
of parts and mechanisms to describe systems states. Such a geometric representa- 
tion results in more complex computational requirements for geometric reasoning 
about feasibility of operations, and therefore an increased difficulty to search for 
feasible sequences. 

In previous work[47, 48, 49, 50], we have introduced the AND/OR graph repre- 
sentation of assembly plans. The AND/OR graph provides a compact representation 
of state relations for the specific domain of assembly. In assembly tasks, state re- 
lations are governed by a strict recursive decomposition relation described by the 
AND/OR tree. The resulting data structure is compact and efficient to search. 
In practice, the complete AND/OR graph may not be generated when the search 
process is bounded at execution-time. 

In this chapter, we describe an extension of the AND/OR graph from a ‘tree 
to a ‘net’ structure. The resulting AND/OR net is a more general representation of 
geometric configurations which lends itself to a compact state description of a more 
general robotic system. The AND/OR net representation is described in detail in 

the next section. 

The AND/OR net is introduced as a compact representation of feasible sys- 
tem states and state transitions, and incorporates all feasible operations sequences 
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for any given task. As a means to analyze and evaluate these possible operations 
sequences, we introduce the AND/OR net to Petri net mapping. Use of this alter- 
nate Petri net representation allows us to characterize the resulting system in terms 
of well-known properties of liveness, 1 -boundedness, safeness, and reversibility of 
discrete-event systems. The resulting Petri net also provides a means to construct 
a task-level controller for execution of the final operations sequence. 

3.2 AND/OR Net Representation 

The representation of assembly plans in our previous work is based on an 
AND/OR graph [4 7, 48, 49, 50]. AND/OR graphs have AND-arcs connecting one 
initial node to k terminal nodes. The basic definition of an AND/OR graph is: 

Definition 3.1 An AND/OR graph is a pair of sets (V, H) in which V is a finite 
set, and H is a subset of the Cartesian product V x ( 11(10 - { 0 }), where R{V) is 
the set of all subsets of V. 

The elements of V are called nodes, and the elements of H are called AND-arcs. 
For an AND-arc (A, A), the node A is the initial node, and the nodes in A are the 
terminal nodes. The AND-arc (A, A) is incident from A and is incident to the nodes 
in A. The AND-arc (A, A) is said to connect node A to the nodes in A which implies 
that the condition of node A can simultaneously cause the results of nodes in A. 

In this section, we introduce the AND/OR net representation as a means to 
represent generic geometric relations and constraints among objects and devices 
in a robotic system. Given a complete geometric description of objects and object 
relations, the AND /OR graph described above is extended to represent more general 
relationships among objects as system substates. The AND/OR net is defined as 


follows: 
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Definition 3.2 Pair-match set V: Given two finite sets Si = {<ii, a 2 , . . . , a m ), S 2 

= 1 ^2 i ■ * ' ) } ; 

r(s l? s 2 ) = UU{K^ 

t=i i=i 

For example, if E, = {1,2}, £, = {3, {4,5}}, r(E,,E,) = {{1,3}, {1, {4,5}}, 
{2, 3}, {2, {4, 5}}}. 

Definition 3.3 An AND/OR net is a three-tuple (S, A, N) where S is a finite set 
of states AC r(S,n(S)-({*}UUUi<{*i}})). N £ r ( S ’ S )' and 4 

PI AT = 0, where FK-S) is the set of all subsets of S. 

The elements of S are called nodes, the elements of A are called AND-arcs, 
and the elements of N are called IST-arcs , where 1ST refers to “Internal State 
Transition”. The AND-arc {A, V>} is said to connect node A to the nodes in ip, 
ip CS. The IST-arc {A^Aj} is said to connect node Xi to node A 2 . Both AND- 
arcs and IST-arcs are undirected. We introduce IST-arcs because some objects 
or subassemblies may change the shape, size, or have relative motions inside the 
combination of components. These changes cannot be described by a disassembly 
or assembly operation because the set of components are the same before and after 
the operation. Therefore, an AND/OR net incorporates three types of operations: 
assembly and disassembly operations, which are modeled by AND-arcs, and internal 
state change operations, which are modeled by IST-arcs. The representation of 
AND/OR nets can generalize the robotic planning problem from the assembly to 
moving objects, material handling, or other task-oriented problem. 

AND /OR nets and AND/OR graphs both have AND-arcs. At a given time, an 
operation can be disjunctively chosen from all feasible operations. They can be used 
for representing parallelism. However, there are several differences between these 
two representations. First, in an AND/OR graph, there is normally a start node 
and some concluding or terminal nodes, while the nodes in an AND/OR net, are not 


32 


ordered in this manner. Each node could represent one substate of an initial state 
or one substate of a final state. Therefore, an AND/OR net is a more generalized 
representation of a robotic system. Second, the arcs in an AND/OR graph are 
directed while the arcs in an AND/OR net are bidirectional, which means both 
directions may be feasible when we show the information flow or transition flow. 
An AND/OR graph contains no cycles, while an AND/OR net has no assumption 
of acyclicity. Third, in an AND/OR graph, the initial state can be represented by 
a single start node, while, in contrast, the initial state of an AND/OR net may 
occupy several nodes in the net. Fourth, there is no arc in an AND/OR graph 
which corresponds to the IST-arc in an AND/OR net. Because each arc in an 
AND/OR net can be considered bidirectional, the AND/OR graph representation 
can be thought of as a special case of the AND/OR net. 

3.2.1 AND/OR Net Algorithm 

Consider a system which contains M geometric substates, including, objects 
of one component, i.e., S}, 5], ..., 5^, subassemblies of two components, i.e., 
Si, 5f, ..., 5^, ..., and assemblies of n components, 5", 5£, ... , 5", where 
Pi + P? + ■■■+ Pn = M. The algorithm for obtaining the AND/OR net from the 
geometric state representation is shown below: 

Algorithm 3.1 Obtaining the AND/OR net from a system geometric state repre- 
sentation. 

Input: system geometric state representation. 

Output: AND/OR net N A = (S, A,N). 

1. Initialize 5 = 0. For each geometric state 5j in the system geometric state 
representation, 5 = 5U{5’j}; 
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2. For i = n to 2 
For j — 1 to pi 
Consider Sj, 

2.1 if there is an S' u {u ^ j ) which contains the same components as S’*, and there 
is no 1ST between S' } and S' u1 add an arc between S’* and S' U (IST ) in iV; 

2.2 Find all feasible S^j 1 and S^ 2 (ki < i, < *)> w h ere ^t, 1 an( ^ have no common 
components, and S£ together with Sjg contain the same components as those 
in S', add an AND-arc between S) and S 6 *j l , Sjg in A. 

Using this algorithm, we observe that each subassembly of order n may be 
further decomposed in 2 n_1 - 1 ways. Only those decompositions which are geo- 
metrically feasible, i.e., we can find the corresponding set of disassemblies in the 
geometric state representation, and show that a collision-free path is available, are 
included in the AND/OR net. In addition, objects with internal state changes are 
indicated by dark links in the AND/OR net. 

Therefore, the nodes in the AND/OR net correspond to all objects, which may 
be subassemblies and assemblies, appearing in the geometric states representation. 
The AND-arcs represent the feasible decompositions from subassemblies(assemblies) 
to a corresponding set of subassemblies. The IST-arcs represent the feasible internal 
state transitions from a subassembly(assembly) to another subassembly(assembly). 
These two subassemblies(assemblies) are listed in the same column in the geometric 
states representation and contain the same number of original components. 

An example of an AND/OR net definition is shown in Figures 3.1 to 3.3. Figure 
3.1 shows a robot which transfers an object on the floor to the surface of a table. 
The initial state and final state are presented in Figure 3.1. All feasible geometric 
relationships among these objects are shown in the geometric state representation 
in Figure 3.2. For simplicity in this example, the floor is not considered a defined 


object. 
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Figure 3.3: The AND/OR net representation for the example. 

The maximum number of steps of generating the AND/OR net is C" + Cj + 
. . . + C" = 2 n — 1, where n is the number of components in the system and C n 
indicates the combinations of n. Within each step, we may obtain more than one 
configuration of single components or contacting objects. The resulting AND/OR 
net state representation is shown in Figure 3.3 and is based on the feasible decom- 
positions of subassemblies of order n to subassemblies of order no more than n — 1. 
In the next sections, we will describe the mapping of this AND/OR net to a Petri 
net. 

Methods for extracting all possible sequences from the AND/OR graph or 
AND/OR tree representation of the system will in general not work for the AND/OR 
net. First, cycles may appear in an AND/OR net, and the methods developed in 
AND/OR graphs for automatically searching task sequences are no longer valid. 
However, the AND/OR net often possesses properties which simplify the represen- 
tation and search process. Under many common assumptions, an AND/OR net 
possesses the special characteristic of reversibility. In addition, we may consider 
AND/OR graphs or AND/OR trees as special cases of AND/OR nets. An algo- 
rithm for searching in the AND/OR net is described in Section 3.4. 
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3.3 AND/OR Net to Petri Net Mapping 

Some definitions and notations of Petri nets are introduced below. 

Definition 3.4 A Petri net structure, N, is a four-tuple, N = (P,T,a, (3). P — 
{p\,pi, ■ • • ,Pn} is a finite set of places, n > 0; T = {<i, h, ■ . - , t m } is a finite set of 
transitions, m > 0; P f) T = 0. a C {P x T) and 0 C { T x P} are sets of directed 

arcs. 

Definition 3.5 Marking p: Marking p of Petri net N is a mapping from set P to 
set A = {0, 1, 2, ..., L} which is a finite set, i.e., 

P : P - A, 

where p sets tokens to every place in N. pi = p{pi) € A indicates the number of 
tokens in place pi. p can be in the form: 

P = (Pi, P2, • • • t Pn) T ', Pi = P{Pi)i Pi ^ P- 

Definition 3.6 Marked Petri net M: A Petri net structure N containing a marking 
p is a marked Petri net which is the following five-tuple, 

M = (. P,T,a,{3,p ). 

Sometimes, for the sake of simplicity, we refer to a marked Petri net as a Petri 
net, as shown later in this chapter. 

Definition 3.7 Petri net graph: The Petri net graph consists of directed arcs and 
two kinds of nodes. In the graph, circle nodes and bar nodes represent places and 
transitions respectively. The directed arc, which links the circle node and the bar 
node, indicates the relation between place and transition. Marking p is indicated 
by solid dots in circle nodes. 
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One important property of a Petri net is the representation of serial and con- 
current events and resource constraints. For this research, we use the Generalized 
Stochastic Petri Nets(GSPN) software[73, 74] to represent the system and carry out 
simulations as well as verify the task sequences. 

3.3.1 AND/OR Net to Petri Net Mapping Algorithm 

For an undirected arc { , A 2 } £ N in an AND/OR net, the mapping to 
elements in a Petri net is defined as a function T\, where 

F i ( { Ai , A 2 } ) = (Ai,fi)U(fi, A2)U(A 2 ,f2)lJ(*2> Ai). 

For an AND-arc {A,0} £ A in an AND/OR net, the mapping to elements in 
a Petri net is defined as a function J - 2 , where 

^2 ( { A , 0 } ) = [J(*2i A), Aj £ 0. 

i=l 1=1 

The algorithm for converting an AND/OR net to the corresponding Petri net 
is shown as follows: 

Algorithm 3.2 Mapping from an AND/OR net to a Petri net. 

Input: AND/OR net = (5, A, N). 

Output: Petri net Np = 

1. initialize P = T = a = j3 = 0, np = np = 0; 

2. for each set n, £ N,n< = {n,i,rij 2 } 

begin 

add 2 transitions f nr+1 ,f nT+2 , 

^ = ^U{^n r +l, fn r +2}; 
n t = np + 2; 

check whether n tl ,n,- 2 is in P, 
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i/n tl not in P, P = .PU{ n <i}' n P = n P + 

1 / n ,2 not in P, P = P U{ n i 2 }> n P = np + 1; 

a = aU{(^l^n r +l),( n .2> i n T +2)}; 

P = /5U{(<n r +l> n «2),( i n r +2,n, 1 )}; 

end 

3. for each set ai € A, a, = {a\,tp „} 
begin 

add 2 transitions t nT +i,tn T +2, 

T = T |J{i nr +i, f„ T +2}; 
nj = nj + 2; 

/or every e^ € {a*} U V'o an ^ i e j} fl P = to, 

P = PUiej}: n P - n P + 1; 
a = aUU{(aA,W+iM e J’*"T+2)}> for al1 e v 

P = /?UUi{(<n T +l» e i)’(*"T+2> a ^)}’ for a11 e J> 

end 

A Petri net representation for the example in Figure 3.1 is shown in Figure 
3.4. The initial marking of one token in places S, R, and T represents the initial 
state, i.e., there are one robot, one table, and one object available and they are 
geometrically independent. The important properties of the resulting Petri net may 
be shown as follows: 

Theorem 3.1 The Petri net mapped from an AND/OR net is safe. 

Proof: Because the Petri net is mapped from an AND/OR net, we clarify the 
meanings of AND-arc and IST-arc. The IST-arc in the AND/OR net corresponds 
to the internal geometric state change inside an object. All possible assemblies of 
n objects, and all possible subassemblies of m objects are special cases of objects. 
The AND-arc in the AND/OR net corresponds to combining the geometric states 


40 



Figure 3.4: The Petri net representation for the example, 
of two or more objects. 

Suppose Np = ( P , T, a, (3) with initial marking p. Choose any place p, e P\ 
P-' € R(N P , p) represents a marking which can be reached from fi. If we could verify 
that fi'(pi) < 1 for all possible p 1 and i, then the proof is completed. 

Pi might connect with neighboring places in two ways(Figure 3.5). 

Case 1: Corresponding to the internal state change of geometric substates of 
a component or a related set of components in the system(Figure 3.5(a)). 

Suppose fi'(pi) > 2. For the sake of simplicity, we assume fi'(p,) = 2. There 
should exist a p" € R(Np,p) and fi' 6 R{Np,p") such that p'(p t ) = 2 and p"(p t ) = 
1 , and p! is immediately reached from fi" . Therefore, at the time of marking p", 
!*"( Pi ) = p"(Pj) = 1 , Pj and p, are neighboring places in the Petri net. Because 
the Petri net is mapped from the AND/OR net and this case concerns the internal 
geometric state change, we conclude that at the time of marking p", the two feasible 
internal states of a single component or a related set of components could appear 
simultaneously. The contradiction is thus obtained. 

Case 2: Corresponding to the assembly and disassembly relationship among 
one subassembly or assembly with a set of other subassemblies or single components 
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(a) One neighbor (b) Two or more neighbors 

Figure 3.5: The connectedness with p, and its neighboring places. 


in the system. 

(i) pi is as shown in Figure 3.5(b). 

Also suppose p'{j>i) = 2. There should exist a p" such that p (pi) — 2 and 

p"{pi) = 1. Therefore, at the time of p" , p"{pi) = p"(Pji ) = p"{Ph) = ■■■ = p (Pj k ) 
— 1, p"(pj J, • • ■, p"(p Ju ), • • •, p"(Pj k ) are combining neighboring geometric states in 

the AND/OR net, 1 < u < k. We conclude that at the same time of p", the two 
possible combining geometric states, which include exactly the same objects, could 
appear simultaneously. A contradiction is thus obtained again. 

(ii) pi is in the place of pj u as shown in Figure 3.5(b). 

Follow the same procedure as in case 1. We could conclude that at the time 
of p", two possible combining geometric states, which contain at least one common 
object, would appear simultaneously. A contradiction is obtained. 

Therefore, the safeness of the Petri net mapped from an AND/OR net is 
assured. 

Q.E.D. □ 

Corollary 3.1 The Petri net mapped from an AND/OR net is l-hounded. 


This corollary is directly derived from Theorem 3.1 because the number of 
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tokens in any place cannot exceed 1. 

Theorem 3.2 The Petri net mapped from an AND/OR net is live. 

Proof: Based on the properties of generating the AND/OR net from the system 
geometric state representation, we know that each IST-arc and AND-arc is feasible, 
and each transition in the Petri net is feasible if we have tokens in the corresponding 
incident places. If we can verify that no matter what marking p' has been reached 
from the initial marking p, it is possible to ultimately fire any transition of the net 
through some further firing sequence, then the proof is obtained. 

Because at any time, the system contains all components and each component 
is in a geometric substate. To get tokens for all incident places for any transition 
simultaneously, using the property that no common components are existing in these 
places at the same time, we can first follow a sequence to get all geometric substates 
for single components. Then, we follow two or more distinct sequences to obtain 
the tokens in the incident places of the selected transition, respectively. Therefore, 
the liveness of the Petri net mapped from an AND/OR net is proven. 

Q.E.D. □ 

Theorem 3.3 The Petri net mapped from an AND/OR net is reversible. 

Proof: As shown in the proof of Theorem 3.2, the Petri net is a set of loops according 
to the mapping definitions. If we define each pair of transitions in the net as t, and 
t[, when p' is reached from p following t^t-i . . . f p , we can resume the marking of p 
from p' following i' t'_ x . . ,t\. Therefore, the initial marking is reachable from all 
reachable markings. The Petri net is thus reversible. 

Q.E.D. □ 

The live Petri net guarantees a deadlock-free system. The boundedness prop- 
erty ensures that the capacity is not exceeded. And the reversibility implies that the 
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system can re-initialize itself, and is important for the automatic recovery from er- 
rors and failures. Therefore, if a robotic assembly or handling system is represented 
as an AND/OR net, it is not only convenient for the system to generate task plans, 
but also the controller will supervise and coordinate the system more efficiently. 

This mapped Petri net does not satisfy the property of conservation because 
of the geometric characteristics of the system. 

3.3.2 Directed AND/OR Net and the Properties of the Mapped Petri 
Net 

In some practical cases, each operation represented in an AND/OR net is 
not reversible. For example, the product generated by some physical assembly 
operation cannot be disassembled following the same strategy as assembly. We 
define a directed AND/OR net which incorporates both undirected arcs and directed 

arcs. 

Definition 3.8 A directed AND/OR net is a five-tuple (S, A, A', N, N') where 5 
is a finite set of states {sj, sj, • • • > 5 t}> n(*5) — ({®} U U,=i { {^«}}))> 

A' c S X (11(5) - {0} - U((s.})) U (11(5) - (0) - U(M» * 5 - 

1=1 1=1 

N c T(S,S), N'CSxS, and Af]A’ = 0, A f\N = 0, Nf)N' = 0, A'f\N' = 0, 
Af\N' = 0, and A'f \N = 0, where n(5) is the set of all subsets of 5. 

A directed AND/OR net may be mapped to a Petri net, by adding one tran- 
sition instead of two transitions for directed arcs, with the same direction of that in 
the directed AND/OR net, for all directed arcs in the net. Therefore, in the map- 
ping algorithm, we add a checking command to see whether the current arc in the 
AND /OR net is directed or undirected, before adding the corresponding transitions 

and arcs in the Petri net. 
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Some properties are not guaranteed in the Petri net mapped from a directed 
AND/OR net. Liveness and reversibility are not guaranteed because of the existence 
of some directed arcs. To be more accurate, based on the definition of different 
levels of liveness[27, 61], the resulting Petri net is strictly LI - Live , because each 
transition in the net can be fired at least once in some firing sequence from the 
initial marking p, and some transitions cannot be fired any finite number of times 
in any firing sequence. The properties of safeness and thus 1-boundedness of the 
directed Petri net are guaranteed. 

Lemma 3.1 If a Petri net is safe, when one or more transitions are deleted, the 
remaining net still retains the property of safeness. 

Proof: We assume the original net is N and the modified net is N'. Suppose we 
can find a sequence of transition f if 2 • • • t p in N' such that one place receives more 
than one token. Therefore, following the same sequence in N, we can also obtain 
the same result. This leads to the contradiction with the property of safeness of 
N and thus no such sequence exists. We conclude that N ' retains the property of 
safeness. 

Q.E.D. □ 

Lemma 3.2 If a Petri net is bounded, when one or more transitions are deleted, 
the remaining net still retains the property of boundedness. 

Proof: The proof strategy is the same as in Lemma 3.1. If we suppose there exists a 
sequence to destroy the property of boundedness in N 1 , we will reach a contradiction 
to the known assumption. Therefore, the property of boundedness is inherited in 
N' which is generated through deleting some transitions in N. 

Q.E.D. □ 

Theorem 3.4 The Petri net mapped from a directed AND/OR net is safe. 
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Proof: Using Lemma 3.1, we consider the Petri net mapped from a directed 
AND/OR net as generated through deleting some transitions in a complete Petri 
net which is mapped from an ordinary AND/OR net. Because this complete Petri 
net is safe, the directed Petri net is also safe. 

Q.E.D. □ 

Corollary 3.2 The Petri net mapped from a directed AND/OR net is 1-bounded. 

This corollary is directly derived from Theorem 3.4 because the number of 
tokens in any place cannot exceed 1. 

3.4 Data Structure for Searching Sequences in the AND/OR Net 

To search feasible sequences from the AND/OR net representation of a robotic 
system, an efficient data structure is required. Two possible requirements may be 
proposed for practical implementation situations: one is the problem of searching all 
possible operations sequences for the given initial state and final state, and another 
is the problem of searching the optimal sequence under certain evaluation criteria 
such as cost, number of steps, or flexibility. The complexity of the first problem is 

much greater than that of the second one. 

The search in an AND/OR graph is a recursive procedure which is guaranteed 
to terminate under the assumption of acyclicity. To search all possible solution 
graphs from the start node to a set of terminal nodes in an AND/OR graph, a 
breadth-first search algorithm could be defined. To find the optimal solution graph 
with minimum cost, a heuristic search procedure, AO* algorithm[87], was used to 
speed up the search. The AO’ algorithm consists of two major operations, a top- 
down graph expanding procedure and a bottom-up cost revision procedure. The 
search algorithm for AND/OR graphs could not be used to search AND/OR nets 
because of their different topologies and properties. 
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3.4.1 Searching All Possible Sequences 

It may not be possible to represent the state of a robotic system by a single 
node in the AND/OR net. For example, the initial state Si may consist of a set of k 
objects, {0i, 02 , . . . , 0fc}, where 0, represents either a component, a subassembly, 
or an assembly. To find all possible operations sequences, which consist of AND-arcs 
and IST-arcs, from the initial object set to the final object set, we first transform 
each distributed node set in an AND/OR net to a distinct node in a corresponding 
state graph. Our algorithm Is mainly divided into two steps: 

1. Create a directed state graph, where each node in the graph represents a 
feasible system state, and each directed arc points from one node to another and is 
marked with a label of a feasible operation. 

2. Generate all possible paths from the node which corresponds to the initial 
state to the node which represents the final state. 

Because the complete algorithm is quite complicated, we only informally dis- 
cuss some important ideas related to the data structure inside the algorithm. 

To create the state graph, we have a linear sequential structure C which may 
be implemented by an array. Each node in C represents a system state. Two 
pointers, Pt x , which is to indicate the intersecting position of the states which have 
been processed and not processed, and Pt 2 , which is to mark the index of the last 
inserted state, are used. Initially, C consists of only Si. If Pt x ± Pt 2 , and the 
current state is not the final state Sf, the set of objects representing this state will 
be used to search from the feasible-operation-base to find all enabled operations. 
Correspondingly, each new state reached by an enabled operation will be compared 
with every existing state in C to decide whether it should be added to C. In either 
case, a directed ’arc marked with the label of this operation will be added to £. For 
each node in C, the number of nodes it points at will also be recorded. Eventually, 
because of the finite number of components in the system, C will stop developing 
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and all feasible states are incorporated in this graph. The resulting graph is a finite 
automaton with one final state. 

The complexity of the generation of the state graph depends on the practical 
implementation of a robotic system because the comparison of each existing state 
with a new state is quite expensive. Also, the same state may be created many 
times and at each time the comparison should be performed. Searching in the 
feasible-operation-base also adds to the complexity. A binary search strategy or 
a heap structure^] cannot be used here to raise the efficiency of search because 
otherwise the arcs in the state graph would be frequently modified and thus costly. 
The complexity is fl(n 2 + mn), where n is the number of feasible states in the final 
graph and m is the number of feasible operations. 

The next step is to find all sequences from £. For this task, we use a data 
structure A to store the intermediate states which are being processed, and these 
states point to the corresponding partial sequences which are being developed. This 
data structure could be either a queue or a stack, which corresponds to the breadth- 
first and the depth-first search, respectively. The states in A could also be ordered, 
which corresponds to a heuristic search to find the smallest cost path. We will 
discuss it using another more efficient strategy in the next subsection. 

Suppose the enabled operations in the state graph for the initial state Si is 
f/,, f/ n . . ., and ti p . In the first step, we push the corresponding child states of 5/, 
S r Si 7 , . . ., - S/p, into A, and make them point to the partial sequences, f/, , t [ ,, . . 
and t{ p . The following iterations will process and delete a state in one end of A. Its 
child states are compared with the final state and the results control whether to add 
the corresponding enabled operations to the partial sequences. The procedure for 
developing a partial sequence continues until (1) a duplicate transition is found for a 
partial sequence, in this case, the partial sequence will be discarded, or (2) the final 
state is reached, in this case, the complete sequence will be output or stored. This 
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algorithm is guaranteed to stop(A becomes empty) because the feasible operations 
and the feasible states are finite. All complete sequences are stored in a set and could 
be evaluated or selected after the searching process stops. The complexity for this 
type of search and the number of all possible sequences depends on (1) the size and 
the configuration of the state graph, (2) the cost of comparing a currently enabled 
operation with each operation existing in the corresponding partial sequence. The 
storage for the scripts of all possible sequences is also not predictable and therefore 
may be large. During the procedure of generating all possible sequences, if we add 
some constraints such as the maximum number of operations in a sequence, the 
maximum number of sequences we want to generate, the maximum cost for each 
sequence, and so on, a reduced set of possible sequences is obtained and search time 
and space required may be reduced. 

3.4.2 Searching the Shortest Sequence 

In many cases, we wish to search the shortest sequence directly from the 
AND/OR net representation rather than to choose from a set of all possible se- 
quences. When there is a weight or cost function for each feasible operation defined 
a priori , the shortest operations sequence is defined as the sequence from the initial 
state to the final state with the lowest cumulative cost. When there are no costs 
defined for the operations, the shortest sequence is considered as the sequence with 
the fewest number of steps. 

We use a methodology similar to Dijkstra[30] for searching the shortest path 
from a weighted graph which is based on a greedy strategy. Given two arbitrary 
nodes, v and to, in the graph, Dijkstra’s algorithm is to find the shortest path from v 
to w in 0(n 2 ) time, where n is the number of vertices in the graph. This algorithm 
is based on a strategy of generating a search tree which always chooses an edge, 
such that the cost from the node on one end of the edge to the starting node is the 
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smallest. Eventually the search tree will reach w. If we directly use this algorithm 
to search the shortest sequence, the complexity will be ft(n 2 + mn) + 0(n 2 ) = 
ft(n 2 + mn), where n is the number of all feasible states and m is the number of all 

feasible operations. 

In our algorithm, we look for a search tree at the same time as the state 
graph is created. Suppose the partial graph we are developing is G, and the partial 
search tree is T. Initially, G = T = 0. When the search starts, G = T = {5/}. 
The algorithm for searching the shortest path from the AND/OR net is informally 
shown as follows. The notations are: (1) 5^ rr represents the current state which is 
being processed and Scurr, Is one of the child state of Scum (2) c(S } ) is the minimum 
cost of path from 5/ to S r (3) arc{S h ,S„) represents the directed arc connecting 
from S h to S J2 , (4) u>(arc(.)) is the cost of the corresponding arc. 

Scurr — Si', COSt(Scurr') = 0 ) 
while Scurr / Sjr(final state) do 

(1) Jot each child state, Scurrit of Scurr 

if Scurr, is in G and c(Scurr.) > c(Scurr) + w(arc(S C urr ) Scurry )) 
delete the arc connecting Scurr , and a node in G and 
add ar S cum Scurr, ^ to G, 
if Scurr, is not in G 

add Scurr, and arc(5 , C t 1 rr> Scurri) in ^5 

(2) find a g 1 €. G - T which has a cost of min;j(cosf(f,) + w(arc(ti, g : )) 

from Si to it, ti € T, gj € G — T\ 

Put it into T and mark it as Scurr « 

This algorithm will stop if the final state is met and the path could be traced 
from Sf back to 5/. And the shortest cost from the initial state to all other states 
in T will be found in order of increasing cost. The proof of the correctness of our 
algorithm is quite straightforward, and we omit the proof here. The complexity is 
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0(n' 2 + n'm) where n' is the number of feasible states which will be developed for 
G, n' < n, and m is the number of feasible sequences. This complexity is clearly 
less than that discussed above. 

Using these algorithms for searching, we can generate a state graph for the 
AND/OR net example shown in Figure 3.3, and obtain the task sequences required. 
In this case, only one possible sequence is available. This sequence could be mapped 
to a sequence of transitions in the mapped Petri net. The firings of this sequence 
of transitions and the corresponding sequence of markings are shown in Figure 3.6. 
Note that the sequence of places in markings are: R, S, T, SR, ST, and RST, 
respectively. 

3.4.3 Searching Sequences in Resulting Petri Nets 

We could also search sequences from the Petri net which is mapped from 
the AND/OR net. In this case, the task planning problem maps to a reachability 
problem in the Petri net, which is a basic Petri net analysis problem[89]. From the 
task sequence planning point of view, we are not only interested in whether a final 
state, /i/, can be reached from the initial state, we also require the sequence used 
to reach the final state. In such a reachability tree generated from a Petri net, the 
number of leaves in the tree is the number of all possible task sequences. The depth 
of the tree is the length of the sequence. The length of the shortest path from the 
root to a leaf is the number of operations in the optimal sequence in the sense of 
the number of steps. To represent a task sequence from the reachability tree, we 
can either show a sequence of transitions, or a sequence of system states. The Petri 
net can be used to simulate and verify the sequences selected. 

Compared with the search algorithm for all possible operations sequences dis- 
cussed for AND/OR nets, the time for creating a state graph and a reachability tree 
is the same, while the representation size of the reachability tree is much greater 
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(a) Transition fireablc: tl 
Marking: 111000 
Operation: None 


(b) Transition fireable: t2, t3 
Marking: 001100 
Operation: Robot grasps solid 


(c) Transition fireable: t4, t5 
Marking: 000001 
Operation: Robot reaches table 


(d) Transition fireable: t6 
Marking: 100010 
Operation: Robot leaves table 


Figure 3.6: The sequence of markings and corresponding operations. 
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because of many duplicate nodes. However, the feasible operations sequences can 
be directly found from the reachability tree. Similar to the discussions on AND/OR 
nets, it is also not economical to find an optimal sequence using the method of the 
reachability tree. 

3.5 Example of Task Sequence planning Using AND/OR nets 

Another example of a task sequence plan is provided by the problem of a 
robot, two tables, and a book shown in Figure 3.7. An initial state and a desired 
final state are mapped to their geometric descriptions. All feasible geometric states 
for one object, two objects and three objects are shown in Figure 3.8. For this 
problem, we assume the maximum size of the robot gripper is not large enough for 
the robot to grasp the book when the book is fully lying on the table. It is thus 
necessary to first move the book to the edge of the table and try to pick up the 
book from one side. Two cases for the connectedness of the book and the table 
are considered. For the connectedness of three objects, the cases are more complex 
because of the relative geometric relations between the book and table. When the 
book is on the edge of the table and the robot is touching one side of the book, we 
ignore the place of the robot relative to the table, i.e., {T\BR) 4 and (T 2 BR) 4 may 
include two kinds of geometric relations. 

From the system geometric states and Algorithm 3.1, we obtain the AND/OR 
net representation for the task(Figure 3.9). For simplicity of the figure, the net 
is shown as separate subnets, but because of the common nodes in each subnet, 
it is really a connected net. We map this AND/OR net to the Petri net(Figure 
3.10) following Algorithm 3.2. The description for each operation could be deduced 
from the Petri net and the corresponding system geometric states descriptions. By 
searching the AND/OR net directly or the reachability tree of this Petri net, we 
obtain all possible task sequences. The optimal(shortest) sequence in this case is 



(b) 


Figure 3.7: A robot moves a book from table 1 to table 2. (a) Initial state, (b) 
Final state. 









Figure 3.9: The AND/OR net representation for moving book. 
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shown as follows: 

1. £i 0 : the robot moves towards table 1 and touches the book which is 
lying on the surface of table 1. 

2. 1 1 4 : the robot forces the book on table 1 to move to the edge of the 
table. 

3. f ii : the robot leaves the book and table 1. 

4. t 6 : the robot reaches table 1 again and grasps the book towards the 
edge of table 1. 

5. t 4 : the robot which has grasped the book leaves table 1. 

6. 1 15: the robot moves towards table 2 and makes the book touch the 
surface and lie on the edge of table 2. 

7. t\ 7 - . the robot leaves the book and table 2. 

8. ^24- the robot touches the book again but the orientation of the 
gripper has already been changed. 

9. ^25* the robot forces the book to move to the center of the surface of 
table 2. 

10. tn' the robot leaves the book and table 2 and then goes back to its 
original place. 

This is the only shortest-path solution which could be found for this problem. 
This optimal task sequence is illustrated in Figure 3.11. This sequence is reversible. 

3.6 Conclusions 

The AND/OR net is introduced as a tool for representation and reasoning 
about geometric constraints in a robotic workcell system. A method for mapping 
the AND/OR net to a Petri net is provided. Some properties of this Petri net are 
also verified. A directed Petri net is discussed to include more general cases for 
modeling a system. We could obtain all possible task sequences by searching from 


p(T2BR)l 


p(T2BR)2 p(T2BR)3^^j^ p(T2BR)4 


Figure 


3.10: The Petri net representation for moving book. 
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the state graph resulting from the AND/OR net, or constructing the reachability 
tree from the Petri net. The optimal task sequence could be directly searched from 
the AND/OR net without necessarily creating the complete state space. This off-line 
planning system has been implemented. The ideas presented here can be applied to 
robotic planning problems in manufacturing and non-manufacturing domains. 

The selection and evaluation of all feasible task sequences, is an important 
dimension of this work and depends on factors such as time, cost, flexibility, or least- 
error-possibility. Another extension of this work involves selection and execution of 
parallel operations when a chosen sequence is implemented, so that the time is 
reduced and resources are used efficiently. The work discussed in this chapter also 
leads to approaches to error detection and recovery. 


CHAPTER 4 

TASK DECOMPOSITION AND ANALYSIS OF ROBOTIC 
ASSEMBLY TASK PLANS USING PETRI NETS 

This chapter describes an approach to robotic task sequence planning which decom- 
poses tasks into operations sequences for a generic robotic workcell. The approach 
provides a framework for robust execution of tasks through properties of: traceability 
— implicit mapping of operations to task representation, and viability — retaining 
multiple paths for execution. Given the descriptions of the objects in this system 
and all feasible geometric configurations and relationships among these objects and 
combinations of objects, an AND/OR net which describes the relationships of all 
feasible geometric states and associated feasibility criteria for net transitions is gen- 
erated. This AND/OR net is mapped into a Petri net which incorporates all feasible 
sequences of high level operations. The resulting Petri net is then decomposed in a 
stepwise manner into lower level Petri nets of which each transition can be directly 
implemented by control commands or command sequences based on devices and 
objects in the system, or, by lower level planning transitions corresponding to path 
planning, grasp planning, fine motion planning, etc. All possible task sequences are 
found using an efficient algorithm which first generates all feasible system states. A 
shortest sequence may be chosen from the lowest level decomposition and is guar- 
anteed to be the shortest sequence output of the hierarchical planning system to 
efficiently implement the desired tasks. The property analysis for different levels of 
decomposition is also presented, and the inheritance of properties between levels is 
defined. 
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4.1 Introduction 

Assembly sequence planning generates sequences of mating operations among 
objects which will be assembled, including both the original single components and 
the subassemblies. The AND/OR graph[47] is an efficient way to represent all fea- 
sible assembly sequences at this level of task description[48, 49, 100]. For a robotic 
assembly system, operations which incorporate active devices such as robots or sen- 
sors require a more complete description of feasible tasks and a plan for the execution 
sequences of these devices. The resulting plans facilitate real time implementation 

and coordination between high level planning and lower level control. In this chapter 

* 

we describe a decomposition of high level task sequences using a Petri net repre- 
sentation which facilitates the analysis of robustness properties for the resulting 

plans. 

An assembly task may be represented by the feasible geometric states of ob- 
jects and the transitions among those states, and the assembly sequence planner 
selects feasible sequences of these states and transitions. When an assembly task 
sequence is selected, each task must be further decomposed to generate a lower level 
operations sequence. Such a decomposition raises fundamental issues regarding the 
properties of the resulting operations sequence. New deadlock situations, conflicts 
among resources, and error states may arise in the decomposed sequence which were 
not present at the higher level. In this chapter, we describe an approach to assembly 
plan decomposition which retains two important properties: (1) traceability — each 
action is traceable to its role in the higher level plan, and (2) viability several 
paths of actions may be retained and chosen on line. These properties are specifi- 
cally intended to support robust execution of the task, and overcome difficulties in 
resource conflict and error recovery. 

In this chapter, we use an AND/OR net[10, 11, 13, 16] to represent task 
level sequences and then follow a top-down hierarchical decomposition procedure 
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based on Petri nets to develop a more comprehensive robotic task representation. 
We search among feasible sequences from the final net using an efficient search 
algorithm. This representation and decomposition procedure is described in the 
following sections. Section 4.2 describes the decomposition of operations for a task. 
Section 4.3 summarizes the AND/OR net representation for high level tasks, as well 
as the mapping from an AND/OR net to a Petri net. Section 4.4 describes the 
decomposition of commands or transitions from different assembly or disassembly 
operations. In section 4.5, the net is further decomposed based on types of device 
motion and sensors. Section 4.6 discusses the simulation results for decompositions 
and sequences searched from the nets, and Section 4.7 discusses the conclusions of 
this work and directions for future work. 

4.2 Representation of a Robotic Assembly System 

Consider a generic assembly system composed of n components, Cl, Ci, . . ., 
C n . Three possible types of components are defined as follows: 

Definition 4.1 Active components: An active component has controllable motions 
in a defined workspace. It may move other components when combined into a 
subassembly or assembly. 

Definition 4.2 Passive movable components: A type of passive component. A 
passive movable component is defined to be a component which is movable if and 
only if it is operated on by some active component. 

Definition 4.3 Passive static components: A type of passive component. A passive 
static component is fixed in a certain position, and therefore cannot move even if it 
is combined with some active component. 

Usually, the position and orientation of passive static components are known 
prior to the execution of the system, while the position and orientation of passive 
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movable components may be unknown before the system starts and thus may contain 
uncertainties. For example, a block on a table is a passive movable component, but 
the table is considered as a passive static component. The sets of active, passive 
movable, and passive static components are independent and their union is the set 
of components in the system. 

A component group, in which all components are in con- 

tact with each other is called a subassembly, and specifically, a group of components, 
which is a desired configuration in the final state and only appears in the final state, 
is called an assembly. We define an object in the system as either a component, or a 
subassembly, or an assembly. At any given time, the system has some objects and 
we define the system assembly state at that time as the set of these objects. 

An operation may affect this system assembly state by destroying some objects 
and creating some new objects. We assume when an operation is taking place, at 
most two objects may be deleted and at most two new objects may be created. In 
addition, at the time when objects are being deleted or created, exactly one object 
deleted or created may contain one active component. For example, a robot R 
is defined to be an active component. After the robot R holding a component A 
contacts another component 5, two objects, RA(R holds A) and B are deleted and 
one new object, RAB , is created. The resulting object, RAB , is called an active 
object , if it contains one active component and only passive movable components, 
or contains internal states which may be modified. 

The internal state of a component or subassembly is defined in terms of its 
properties . A property of a single component or a subassembly may change, or, 
the parameters corresponding to the interrelationships of some components or sub- 
assemblies within this object may change. For example, if an object 0 consists of 
two components, C\ and C^, and the distance between C\ and Ci is extended, we 
say that the parameter of 0, in this case, the distance, is changed and a new or 
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modified object O' thus takes the place of the old object 0. 

Based on these characteristics of feasible objects, three types of basic opera- 
tions are defined: assembly, disassembly , and Internal State Transition (1ST) oper- 
ations. We define the precondition of an operation as the objects being destroyed, 
and the postcondition of this operation as the new objects being created. For an 
assembly operation, the precondition is two objects, O,, and 0,-,, and the postcondi- 
tion is one object, Oj. For a disassembly operation, the precondition is one object, 
Oj, and the postcondition is two objects, 0 and O tJ . For an 1ST operation, the 
precondition is one object, 0 { , and the postcondition is another object, Oj. 

In Section 4.3, we will introduce an AND/OR net[10, 11, 13, 16] which rep- 
resents these operations and states. In this representation, if the precondition or 
postcondition of an operation has more than one object, an AND arc is used to 
connect the operation with these objects to show the necessary coexistence of these 
objects. The OR relationship for choosing a feasible operation from all enabled 
operations is represented by several AND arcs or 1ST arcs from the same set of 
nodes. The decomposition of assembly tasks is achieved using a predefined library of 
primitive operations. While these operations may vary in detail for different imple- 
mentations, they capture the fundamental requirements for assembly task execution. 
Section 4.4 describes this decomposition in more detail. 

Each assembly operation is decomposed into a sequence of move and combine. 
To form an assembly configuration by an active component, a motion operation is 
necessary to reach the corresponding object. After motion is performed, a mating 
operation combines the objects by establishing a new contact state. The mating 
operations include insert, screw, grasp, or put operations. 

Similarly, a disassembly operation can be decomposed into a sequence of sep- 
arate and move. The move operation here is in a different direction from that in an 
assembly operation. The unmate operation separates objects by destroying contact 
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relations. The mate and unmate operations are both problem-dependent and their 
implementation depends on the descriptions of tasks. 

There are different types of 1ST operations, and many are problem specific. 
In this chapter, we consider only move-with-contact as an example of an 1ST op- 
eration. Move-with-contact changes the internal configuration of a subassembly by 
sliding objects along contacting surfaces. The property which changes is the relative 
position of parts in the configuration. Sliding an object along a table is an example 
of this type of 1ST operation. 

A move operation is further decomposed into a free-move suboperation and a 
fine-move suboperation. A free-motion assumes a wide range of workspace, relative 
high speed, and no tightly constraining obstacles. A fine-motion moves in a small, 
constrained workspace and moves with a relative slow speed and may often involve 
compliance or contact motions. A free-motion makes an active object roughly reach 
a goal and a fine-motion makes the active object exactly reach a goal. The prece- 
dence of free-motion and fine-motion in motion suboperations for an assembly and a 
disassembly operation are different. For motion in an assembly operation, the free- 
motion precedes the fine-motion, while in a disassembly operation, the fine-motion 
precedes the free-motion. 

Sensors are necessary to assess the current state of a system during execution, 
and a viable planning strategy must incorporate on-line sensor-based decisions. Sen- 
sors are used to restore uncertainties on-line and instantiate lower-level plans. In 
our work, we construct plans with sensors for (1) state verification, (2) state identi- 
fication, and (3) sensor-based control. Sensory state verification and identification 
are used to determine system states and parameters and determine the subsequent 
task sequence. Sensors are also used in lower-level sensor-based operations which in- 
corporate dynamic sensory feedback to achieve adaptive modes of on-line operation. 
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In related work(12, 14, 20, 21], we have shown the use of a fuzzy Petri net represen- 
tation to embed fuzzy reasoning rules and incorporate sensory observations into the 
on-line task sequence. In all of these cases, the sensor becomes a resource constraint 
on the sequence of operations in the system, and the resulting Petri net planning 
tools provide a convenient means to represent and reason about these resources. 

For most operations, a motion plan is required before the operation is executed. 
For sensor-based motion, a plan may specify a mode of sensor-based motion and 
constraints, but not an explicit path. In our task representation, the motion plan 
is also viewed as a resource and modeled as such in the Petri net representation. 
The existence of the plan is therefore an explicit precondition for the execution of 
motion. 

To sequence the generation of plans as well as the task sequences, a planning 
for planning problem occurs, i.e., when to generate a plan for a certain operation 
and how to schedule the generations of all plans in the system. One approach is to 
generate the plan right before the execution of the operation so that the uncertainty 
of the dynamic working environment can be minimized. To reduce the conflict of 
resources in the system, we search a shortest sequence from the final Petri net. This 
sequence will guarantee a smallest number of resource conflicts. 

4.3 AND/OR Net and Petri Net Representation for High Level Tasks 

As discussed in the last section, an assembly operation combines several single 
components or component groups to a new component group. A disassembly opera- 
tion decomposes a component group into a set of single components and component 
groups. An 1ST operation makes an internal state change for a single component or 
a component group. The following discussions are based on the representation and 
sequencing of these operations. 
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Ceiling Camera(Cl) 



Holder(H) 



Strut(Sl) 


4.3.1 AND/OR Net Representation for Assembly Sequences 

Geometric states are used to describe the states for all components and feasible 
component groups in the system. Each assembly, disassembly, or Internal State 
Transition operation can be considered as reaching from one system geometric state 
to another geometric state. The system geometric state was defined in [11, 12]: 

Definition 4.4 System geometric state: A set of objects which constitute the sys- 
tem including single components, subassemblies, or assemblies. Each object has 
geometric substate, which represents the corresponding geometric configuration or 
relations among the components of the object. 

For a strut-triangle assembly system example shown in Figure 4.1, the corre- 
sponding system geometric states table is shown in Table 1. 

Note that each geometric configuration may either represent a contacting re- 
lationship of objects with internal state parameters, or a fixed relationship among 
objects. The fixed relationship is a pre-specified relationship among related objects 


TABLE 1 


SYSTEM GEOMETRIC STATES 


Single Objects 

Type Object External States 

R(robot) 

active 

position / orientation 

H(holder) 

passive static 

posi t ion / orientation 

SI (strut 1) 

passive movable 

position /orientation 

S2(strut 2) 

passive movable 

position/orientation 

S3(strut 3) 

passive movable 

position /orientation 

T(table) 

passive static 

position / orientation 

Cl(ceiling camera) 

passive static 

position /orientation 

C2(arm camera) 

passive static 

position / orientation 

Combined Objects 

Type Object External States 

RSI 

active 


S1H 

passive static 

position / orientation 

RS1H 

active 


S2S3T 

passive movable 


S1S2S3T 

passive movable 

/ joint positions 

RS1S2S3T 

active 

\ grasp point 


Internal States 

joint positions(kinematics) 


Internal States 

/ joint positions 
\ grasp point 

✓ holder slot # 

\ fine position in holder 
/ joint positions 
\ grasp point 

position/orientation of 
S2S3 on table 
position/orientation of 
S1S2S3 on table 
position/orientation of 
RS1S2S3 on table 
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and the non-fixed relationship may be unknown or uncertain. The subassembly of 
an active component and a passive movable component is rigid, for example, the 
robot holding a strut, but the grasping position is an internal state variable. The 
subassembly of a passive movable component and a passive fixed component may or 
may not have a rigid relationship. For example, in Figure 4.1, the subassembly of 
5 2 and 53 has a rigid relationship, while T and 5253(or only 51) have a non-rigid 
relationship. A state verification and validation procedure(sensing) will be followed 
to check and confirm the geometric states for the objects during the execution of the 
assembly or disassembly task. The current state of a non-rigid group is an internal 
variable. 

Each assembly operation may have a reversible decomposition operation. For 
example, the group of T(table), 53(strut 3) and 52(strut 2) represents a non-rigid 
combination of the table and two struts, where the two struts have already formed 
a subassembly for the triangle configuration. The group f?(robot) and 51 (strut 1) 
represent a rigid combination of the robot and a strut which shows that the robot 
is holding a strut. These two groups could be combined or assembled to generate a 
new group of which the robot is touching the assembly of three struts on the table. 
This new group can either be decomposed to two original groups, or be decomposed 
to two new groups. For a non-rigid group or object, the internal state change may 
be defined among all feasible states of this group or object. The system geometric 
states table incorporates all feasible geometric state relationships for possible states 
of components and component groups in the system. 

The AND/OR net[10, 11, 16] was defined in Chapter 3. It is directly derived 
from the geometric states table. The nodes in the AND/OR net correspond to all 
feasible components and component groups, which in turn correspond to all feasible 
configurations in the geometric states table. The arcs in an AND/OR net have two 
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Figure 4.2: The AND/OR net representation. 

types, i.e., AND arcs and /ST arcs. The AND arcs represent the feasible com- 
binations and decompositions of objects or object groups. The 1ST arcs represent 
the internal state changes for component groups or single components. The OR 
mapping indicates the alternate selections for several different operations, i.e., an 
component or component group may either follow an 1ST arc to transfer from one 
state to another state, or be decomposed to a set of new components and com- 
ponent groups, or be combined with other objects to generate a new component 
group. Therefore, the AND/OR net not only represents each operation for assem- 
bly or disassembly, but also represents the relationships among several alternative 
operations. 

The AND/OR net representation for the strut-triangle representation is shown 
in Figure 4.2(The internal state variables are not explicitly shown in the figure). 
Note that the AND/OR net is from the task level point of view. An AND/OR 
net incorporates all feasible assembly/ disassembly/ 1ST sequences. We can directly 
observe an efficient sequence from Figure 4.2, i.e., the robot first reaches Si which 
is held by the holder. Then the robot goes to pick up SI and leaves the holder. 
Afterwards, the robot reaches the subassembly of S2 and S3 which is lying on 
the table and assembles the triangle structure. Last, the robot leaves the table and 
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leaves the strut-triangle on the table. The final state is thus reached. This particular 
assembly/ disassembly/ 1ST task sequence is listed as follows: 

1. R, SlH(initial state) ==> RSlH, // Assembly 

2. RSlH ==> RSI, H, // Disassembly 

3. RSI, S2S3T =£■ RS1S2S3T, // Assembly 

4. RS1S2S3T =£• S1S2S3T, R(final state). // Disassembly 

4.3.2 AND/OR Net to Petri Net Mapping 

To implement convenient communications between the task planner and the 
execution controller and to clearly simulate and analyze the task sequence, we map 
the AND/OR net task level representation to a Petri net[10, 11, 16]. One important 
property of a Petri net is the representation of serial and concurrent events and 
resource constraints. 1 

A formal definition of Petri nets and related properties, as well as the math- 
ematical operations on Petri nets, are defined in [84, 89]. Some definitions and 
notations were introduced in Section 3.3. The mapping of the AND/OR net to the 
Petri net is described in detail in [10, 11, 16]. For A x and A 2 discussed in §3.3.1, t\ 
and f 2 are two new opposite transitions which are added to the Petri net where the 
nodes are being directly mapped to places correspondingly. 

Each node in the AND/OR net is mapped to a place in the Petri net. All 
transitions in the system AND/OR net can occur in either direction based on the 
assumptions of reversibility and feasibility. Using this property, we can map each 
AND/OR net transition, i.e., an AND arc or 1ST arc, to two opposite transitions in 
the Petri net. Each place in the Petri net represents an individual state even though 
some states may represent the same component or component group. Thus the 

^or our current analysis, we use the Generalized Stochastic Petri Nets(GSPN) software[73, 74] 
to represent the system and carry out some simulations as well as verifying the task sequences. 
Some properties of the Petri net such as T-invariants, P-invariants and so on, can be obtained 
using this software. 
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Figure 4.3: The Petri net, PNO, mapped from the AND/OR net. 

Petri net is a complete representation of the system states, which offers advantages 
to model both state and operations sequences. We have shown that the following 
properties of the resulting Petri net, i.e., safeness, 1-boundedness, liveness, and 

reversibility, are guaranteed[10, 11, 16]. 

For the sake of simplicity, we call the Petri net mapped from an AND/OR 
net as a Level 0 Petri net ( or PNO) in the following discussions. PNO for the strut- 
triangle example is shown in Figure 4.3. The initial state is represented by the initial 
marking of the Petri net. Before the operations of the system, the robot is free, strut 
1 is “fixed” on the holder and the subassembly of 52 and 53 is lying on the table. 
This initial state is shown with a token in place R , SlH, and 5253T, respectively. 
The final state will be represented with one token in place R , one token in place H, 
and one token in place 515253T. The states of components and component groups 
existing at the same time are geometrically independent. 
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4.4 Level 1 Petri Net Decomposition 

In this section, we define the high level decomposition of assembly operations 
into move —> combine subsequences, and the decomposition of disassembly opera- 
tions into separate — ► move subsequences, where combine may refer to grasp or mate 
operations in assembly. When replacing each assembly and disassembly transition 
in the AND/OR Petri net by a subsequence of move, combine, and separate opera- 
tions, we generate a Level 1 Petri Net(PNl) in which some common characteristics 
of assembly and disassembly operations may be captured. In this decomposition, 
when we perform the property analysis in the resulting net, we can think of it as an 
expansion by corresponding subnets, rather than a replacement of transitions. 

4.4.1 Decomposition Algorithm: PNO to PNl 

The mapping from PNO to PNl is the first step of the decomposition for assem- 
bly plans. We formally define the decomposition algorithm at this level as follows. 
It is assumed that the number of input objects of any assembly operation, and the 
number of output objects of any disassembly operation, are both 2. 

Decomposition Algorithm 1: Decomposition of PNO to PNl Decompose 
a Petri net PNO N = ( P,T,a,0 ) mapped from an AND/OR net, where P = 

{puPii • • • )Pm}i T = {$i, £ 2 , . . . , f„}, a C {P x T}, 0 C {T x P], to a lower 
level net, PNl. 

for i := 1 to n do 

if U € {assembly operations}, {(p„ , t,), (p, 2 , t,)} C a, (t„p i3 ) £ 0 then 
{Each assembly operation is decomposed to a move command and a combine 
command.} 

T:=T- {*,■} + {tl ff}; n := n + 1; t { := t}; tn := 

{Add a new state for p t) after moving, assuming p tl is or contains an active 
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component.} 

if p" £ P then 

P := P + {p-' }; m := m + 1; p m := p", 
end { if }; 

a := a — {(p«,,*«)» (#*»*»)} + {(Ph * (?£> *i)> (P* 2 >^<)}» 

0 -.= 0-{(U,Pi 3 )} + {(*?,<). 

end { if }; 

elsif € {dtsassemWyjoperah'ons}, (p fl ,t,) € a, {(*,-, Pt 2 ), (*f > P« 3 )} ^ 0 

then 

{Each disassembly operation is decomposed to a separate command and a 
move command.} 

T := T - {*,•} + {*?,<!}; n := n + 1; := <?; t n := *{; 

{Add a new state for p, 2 after moving.} 
if p" £ P then 

P := P + {p-' }; m := m + 1; Pm := p" 2 
end { if }; 

a := a — {(p«i,<«)} + {(Pu > *i)> (pIj> *!)}> 

0 : = /?- {(<i, Pi2 ),(t„p, 3 )} + {(*:,?£)>(*?- p. 3 ), 
end { elsif } 
end { for }. 

4.4.2 Analysis 

After we obtain PNl , we are interested in the analysis of properties such as 
liveness, boundedness, and reversibility of this net. To avoid directly analyzing this 
net which is more complicated than the original net, we investigate whether the 
properties of the original net are inherited after we perform the decomposition. The 
method of applying reduction rules to analyze a large system[62, 84], which reduces 
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it to a smaller and simplified system, is helpful to examine the properties of the 
resulting system when we know the properties of the smaller system before decom- 
position. As an approach to refine the Petri net, Valetteflll] proposed a method 
which replaces the transitions in the net with corresponding subnets, and guaran- 
tees the resulting net to preserve the properties of liveness and safeness. Suzuki and 
Murata[106] generalized the method for stepwise refinement or abstraction of the 
Petri net representation, retaining the properties of liveness and boundedness. To 
refine or simplify a net more efficiently without the loss of properties, Berthelot pro- 
posed a set of transformations^] which preserves the classical properties in nets. A 
decomposition technique was also discussed to split a system into subsystems which 
can be analyzed separately[5]. In another approach, reversibility was considered in 
net decomposition by Zhou et al.[ 122]. 

To analyze the properties of decomposition for our application in robotic sys- 
tems, we propose the following theorem which can be used to show that the resul- 
tant net retains the properties of liveness, 1-boundedness, safeness, and reversibility. 
Partial or similar results can be obtained using the results in [106, 111, 122]. 

Theorem 4.1 If a place in a Petri net shown in Figure 4.4(a) is replaced by a subnet 
shown in 4.4(b), and the original net is live, bounded, safe, and/or reversible, then 
the resulting Petri net is also live, bounded, safe, and/or reversible. 

Proof: We prove the inheritance of properties of liveness, boundedness, safeness, 
and reversibility separately as follows. 

Liveness: Based on the assumption, the net containing Figure 4.4(a) is live, i.e., no 
matter what marking is reached from an initial marking, it is possible to ultimately 
fire any transition of the net by progressing through some further firing sequence. 
Any transition t 6 T can be enabled after a sequence of transition S = t ,, t ,- 3 . . . t it . 
After p is replaced by the subnet in Figure 4.4(b), we have: (i) If S passes through 
p in N, a token will be placed in p via arc (1) or arc (3). Correspondingly, p\ or 
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(a) (b) 

Figure 4 . 4 : Decomposition of a place to a subnet. The net in (a) is N = ( P , T, a, /?), 
and the net in (b) is N' = 

p 2 in N' will get a token. Then, S will pass through arc ( 2 ) or ( 4 ) in N. Again 
correspondingly, in N', S will not change, or, £i, £2, M2, or £ 2 £i is added in the 
sequence, so that each transition £ € T' — {£i,£ 2} can be enabled after a sequence 
of transitions, (ii) If S doesn’t pass through p in N, the sequence which make any 
transition in N' enabled except £1 and £2, will be the same as in N. Moreover, to 
enable each transition in N, p should contain a token at least once. Correspondingly, 
either p\ or p 2 should contain a token at least once. Therefore, £1 and £2 are also 
enabled when p\ or p 2 contains a token. Each transition in N' is enabled after firing 
a certain sequence of transitions. The liveness of N' is guaranteed. 

Boundedness: We need to show that for any place in N, the number of tokens does 
not exceed k. After p is replaced by the subnet in Figure 4 . 4 (b), for any sequence 
of transitions S = £,,£,, . . . £^, we have: (i) If S passes through p, as in the proof of 
liveness, for N', the sequence will be the same, or £1 or t 2 is inserted in the sequence, 
or a loop of £i £ 2 or £ 2 £i is inserted. All these will not change the capacity of tokens 
in places of N'. (ii) If S does not pass through p, the sequence will be the same as 
in N. Therefore, the property of boundedness is verified. 

Safeness: Safeness is a special case of boundedness in which the maximum capacity 
for each place is 1 . Following the same strategy as the proof of boundedness, we can 



77 


also verify the property of safeness of N 1 . 

Reversibility: As in the proof of liveness, we assume a reversible sequence from 
any reachable marking to the initial marking is S = . . . i tj . (i) If this sequence 

passes through p, based on the direction of S following (2) or (4), we get an updated 
<5 which is the same as the original sequence, or with 1 1 or t 2 added, or with a loop 
of t\t 2 or t 2 t\ added, (ii) If this sequence does not pass through p, S will not be 
changed. Moreover, if the reachable marking contains a token in p, then accordingly, 
there is a token in pi or p 2 and the sequence will also be the same or changed with 
ti, t 2 , t\t 2 or t 2 t\ added. In any case, the reversibility property in N' is guaranteed. 

Q.E.D. □ 


4.4.3 PNl for the Example 

For the assembly system shown in Figure 4.1, the objects consist of active 
devices and passive parts. As described in Table 1, the only active device is the 
robot(R). The parts are designated as fixed(static) and movable parts. The fixed 
parts are the table(T) and the holder(/f). The movable parts are strut 1, strut 
2, and strut 3. The combine operations for (R,S1) — + Z?S1 and (R, SlH) —+ 
RSlH are ‘grasp’, while the combine operations for (■Sl,5253T) — ► 51S253T and 
(RSl,S2S3T) — * RS1S2S3T are ‘mate’. 

If we replace each transition in the Petri net shown in Figure 4.3 by associated 
move, combine, and separate operations the PNl net is generated. The resulting 
Petri net is shown in Figure 4.5. Using the above theorem, we know that PNl main- 
tains the properties of liveness, safeness, and reversibility. Using a search algorithm 
for feasible sequences[16] in a Petri net, a feasible task command sequence to reach 
from the initial state to the final state is generated as tl(Move Rl Si, Grasp R1 
Si), t3(Move.Comp RlSl H, Move RlSl Rl(Temp-Pos)), t6(Move RlSl S2S3T, 
Move.Comp RlSl S2S3T), t8(UnGrasp Rl S1S2S3T, Move Rl Rl(Init _Pos)). This 
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Figure 4.5: Level 1 Petri net, PN1, for the example in Figure 4.1. Each transi- 
tion in the net represents an operation. The label indicates the type of operation. 
mv(Move), grs(Grasp), ungrs(UnGrasp), mvcra’ and mvcm( Compliant Move, in dif- 
ferent directions); and the objects involved: Rl(robot 1), Sl(strut 1), INIT(initial 
position of robot 1), RlSl(Rl&Sl subassembly), H(holder), TEMP(temporary 
position of R1S1 in the free space), S2S3T(S2&S3 subassembly on the table), 
S1S2S3T(S1&S2&S3 assembly on the table). The first operand is the movable ob- 
ject. 
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sequence can be linguistically described as: (1) robot 1 moves to strut 1; (2) robot 
1 grasps strut 1; (3) robot 1 holding strut 1 compliantly leaves the holder; (4) robot 
1 holding strut 1 reaches the temporary position; (5) robot 1 holding strut 1 moves 
to subassembly S2S3 on the table; (6) robot 1 holding strut 1 compliantly moves to 
subassembly S2S3 on the table; (7) robot 1 ungrasps assembly S1S2S3 on the table; 
(8) robot 1 moves to the initial position. 

4.5 Level 2 Petri Net Decomposition 

The PNl shown in Figure 4.5 can be further decomposed to a set of lower 
level operations based on the types of motion and the resources required. The 
decomposition of motion is represented by expansion of a move transition into free- 
motion and fine-motion. The addition of resources required for sensing and planning 
is achieved by adding places. In the examples discussed here, places are added to 
represent motion plans and sensors. In the example shown in Figure 4.6, an assembly 
operation is decomposed into motion and mating operations, with motion plans ‘P’ 
required as preconditions, and a camera, C2, required to control the fine-motion. 

4.5.1 Decomposition of Motion to Free-Motion and Fine-Motion 

The following algorithm decomposes each motion operation into free-motion 
and fine-motion steps. In the resulting Level 2 Petri net, no two places represent the 
same state for the same component or group. Because this net can be considered as 
replacing some places by corresponding subnets, and PNl has been shown to have 
properties of liveness, safeness, and reversibility, the resulting PN2 net in Figure 4.7 
also has these properties. The formal algorithm to perform this decomposition is 
shown as follows: 

Decomposition Algorithm 2: Decomposition of Each Motion Command 
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Figure 4.6: Decomposition for the AND/OR net to Level 2 Petri net. In the 

resulting Petri net, places ‘P’ are the precondition plans, for the corresponding 
motion or mating operations. Place ‘C2’ is used to indicate the arm camera, which 
is used for sensor-based motion. 
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in PNl to Free-Motion and Fine-Motion Commands, 
for j := 1 to n do 

if tj = tl {pt,tr)ea, (tlp'DeP then 

{fr 1 is a free-motion command and is a fine-motion command.} 

T:=T- {t[} + {t} 1 ,*- 2 }; n := n + 1; t 3 := if 1 ; t n := *- 2 ; 
if p'j £ P then 

P P + {p'J; m := m + 1; pm := p't 
end { if }; 

a := a — {(pt,^)} + {(P*> (Pt> ^ 2 ))i 
/? := /? - {(<•,?")} + {(^.P'tM^V/)} 
end { if }; 

elsif t 3 = t{, {put’i) G a, (^p") € /? then 
{*{» is a fine-motion command and <j 2 is a free-motion command.} 

T := T - {*{} + {<i l ,<“}; n := n + 1; *; := *» := 

if P( £ P then 

P := P + {p' t }; m := m + 1; p m := p' t 
end { if }; 

a := a — {(pt,^)} + {(Pt> *;*)i (Pt» ^ 2 )}i 

?■■=? -{(<!, pf)} + {(‘!'.pi).(‘! 2 .rf)} 

end { elsif } 
end { for }. 

4.5.2 Adding Resource Places to the Net 

In a further refinement of the plan, we introduce additional lower level objects 
which represent required resources for execution. In these examples, sensors and 
plans are introduced as lower-level objects. 
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Figure 4.8: Adding a place with loop connections to transitions in a Petri net and/or 
a place separable with the net. 


Many transitions may require a plan as a precondition to execution. There are 
four kinds of planners existing for this example: free-motion planners, fine-motion 
planners, grasp planners, and sensor-based motion planners. The plans are often 
implemented on-line because of the uncertain state and the dynamic environment. 

Certain fine motions may require a sensor to perform sensor-based motion. In 
this example, camera 2 is a shared resource and availability of C2 is represented by 
a token in a C2 place. The decomposition is based on the following theorem and 
algorithm. 


Theorem 4.2 If we add a place, which (1) contains a token, (2) forms loop con- 
nections with some transitions, and/or, a separate place without any connection to 
a Petri net(Figure 4.8) which has the properties of liveness, boundedness, safeness, 
and reversibility, the resulting net also preserves these properties. 

Proof: (i) The liveness of a Petri net is determined by firing a sequence of transitions 
and the number of tokens received and produced by transitions. When we fire a 
sequence of transitions, if this sequence passes through the transitions which have 
connections with the specified place, these transitions will not produce different 
numbers of tokens for this place or other places as in the original net. If the sequence 
does not pass through this place, and/or, a separate place is added to the net, the 



84 


sequence firing will be the same as in the original net. In any case, the liveness will 
be inherited by the resulting net. (ii) The boundedness relates to the capacity of 
tokens in each place. As we have shown in proof (i), the boundedness of the original 
net is also preserved in the resulting net. (iii) Because the token in the place we add 
to connect to the original net always contains 1 token, and the number of tokens 
in other places will not exceed 1, the resulting net is safe, (iv) When we follow 
a reversible sequence to go back to the initial state from any reachable marking, 
because the place we add to connect to the net does not influence any transition in 
any sequence, the reversibility property is reserved. The case is the same for adding 
a separate place. 

Q.E.D. □ 

The following algorithm formally proposes the decomposition to add PLAN s 
to all transitions, and a sensor to all sensor-based transitions. 

Decomposition Algorithm 3: Add PLANs for All Transitions and Add 
Sensors to All Sensor-Based Transitions. 

{add plans for all transitions} 
for i := 1 to n do 

P := P + {PLAN,}] m := m + 1; p m := PLANi] := 1 
end { for }; 

{add C2 to all sensor-based transitions} 

P := P + {C2}] m := m + 1; p m •= C2; pt m := 1; 
for i := 1 to n do 
if sensor .based(ti) = TRUE then 

Q := a + {QW.)}; 
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0 '■= 0 + {(*;>Pm)} 
end { if } 
end { for }; 

Based on this theorem, the complete Level 2 Petri net is generated, and the 
result is shown in Figure 4.9 for the example. In Figure 4.9, C2 is a place with loop 
connections to two fine-motion transitions, and each PLAN place(with a token) 
forms a loop connection with the corresponding transition in the original net. We 
conclude that the net decomposed is live, 1-bounded, safe, and reversible. 

4.5.3 Independence of Plans and Sensors 

In the discussion above, the addition of resource places for plans and sensors 
assured that planning and sensing could occur independently. In practice, a sens- 
ing operation may be required to acquire the state of objects before a plan can be 
executed. The augmentation of the Petri net to represent such dependence is more 
dependent on specific configurations and devices. The following algorithm defines 
a decomposition for an assembly task which requires a sensing operation for each 
motion, and a constraint that sensing for the fine-motion requires a free robot hand. 
(This situation occurs when a sensor is attached to the hand, and only functions 
when the hand is empty.) The following algorithm applies to the Petri net in Figure 
4.10. 

Decomposition Algorithm 4: Decomposition for Plan-Sensor Dependence. 


if C-i £ P then 

P:=P+ {C2}; m := m + 1; p m = C2; fi m := 1 
end (if); 


86 2 - 



Figure 4.9: Level 2 Petri net, PN2 , with a resource place, C2, introduced to model 
camera availability. In addition, each move and grasp operation has a resource p ace, 
P. as a precondition. 
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if Ci £ P then 


P P + {Cl}; m := m + 1; p m = Cl; p m := I 
end {if}; 

for j := 1 to n do 


if *i = tl , {«.(?), (ft,, <f), (p.„(P), «„(?■)} C a, {((,'■, C fi 


then 


n n + 6; £„_ s := plan.path ; t n _ 4 := plan.path ; < n _ 3 := plan.path; 
in -2 find.view.pos ; £ n _j := find.view _pos; t n := mv.free(R,p i2 ); 

P •— T {^n j ^n — 1 , in— 2 1 in-3, in-4, in- 5 ); 

m := m + 4; p m _ 3 := VIEW.P0S1; p m _ 2 := VIEW.P0S2; 

p,-, := ff; p„ := FREE-PLAN(R); P := P + {p„,p m _ I ,p m . J , Pm _3} ; 

fi(PLAN(t[ 1 )) := 0 ; p{PLAN{t?)) := 0 

a := a + {(/>,, , *«- 5 ), (Pm-3, *n-s), (Cl, £„_ 2 ), (p,„ £ n _ 2 ), (p m _ 3 , £„_ 3 )} ; 

° a {^*1 ’ in ~ 4 )' (Pm-2) ^n— l), (C2, £ n _i), (Pij, (Pm-l, < n _i)}; 

a a {(^> in), ( Pm , tn), (R, £, 1 - 3 )}; 

0:=!3- {{t? , PLAN(t r t l )),(t?, PLAN(t?))} ; 


0 : = fl+iitn-^Ph), (tn—5, Pm— 3), {in- 5 , PLAN(t ? )), (f„_ 2 , p m _ 3 ), (£„_ 2 , Cl)}; 
/? := ^+{( i n-2,P. 2 ),(£n-3,Pm-3),(£„-4,p' 1 ),(£„-4,PI/liV(£^)),(£ n _ 4 ,p m _ 2 )}; 
/?:=/? + {(£„-!, p m _ 2 ), (£„_!, C2), (£ n -i, PiJ, (£„_!, R ), (£ n ,p m _ x ), (£ n _ 3 , /?), 

{tn— 3, Pm ) } 


end { if } 
end { for } 
end. 


Applying this to our example, we now assume that to obtain the free-motion 
plan for A, camera 1 is required to find the view position of B and then the path 
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planning procedure is called to generate a trajectory to move to an approach posi- 
tion. To obtain the fine-motion plan, we must first clear the robot gripper on which 
the camera is mounted, so that it can freely move to B and use camera 2 which is 
mounted on the robot arm to detect the precise position of B. Using the resulting 
view position of B , we generate a free-motion plan for the robot to move near B 
and view the position of B. Then a fine-motion plan is generated and a fine-motion 
path can be followed to mate B by A. 

If A is an object containing R, a conflict from the resource, R, occurs and 
then a disassembly operation must be performed to the free R from A. After the 
sensing operation by the camera on R is finished, A must be reassembled again. 
The Petri net representation in Figure 4.10 shows the conflicts of resources as well 
as the precedence relationships among the generation of plans and motions. This 
subnet can be merged with the Level 2 Petri net in Figure 4.9 to obtain a final Level 
2 Petri net shown in Figure 4.11. The decomposition for this example is shown for 
the JtlSl, 5253T mating operation. 

Figure 4.11 shows the resulting final Petri net. In one possible sequence, the su- 
pervising planner could go all the way down to the place RlSl and fire the plan.path 
transition to get a free-motion plan. However, the precise position of S2S3T is not 
known because of the non-rigid combination of the table and subassembly S2SZ, 
and mv-free(R, S2SZT) cannot be fired because the robot is not free. The plan- 
ner could generate a sequence to return, get the free robot, and fire find-V Pos. 
After a token has been put into place VP os, we store this state until a token is 
put into iZlSl'l to generate the fine-motion plan. At this time, the robot is free. 
We then go all the way down to the place J?15’1 / 1 again and make the transition 
mv.fine(RlSl, S2S3T) enabled. 

A preferred plan sequences the state identification first, prior to beginning 
assembly. This plan can be found from the sequences generated by the the search 



Figure 4.10: Decomposition for plan-sensor dependence. 
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mv_free(R 1 ,S 1 S2$3T) 

m v_free(R 1 JN1T) 

mv_fine(Rl,SlS2S3T) / \ mv_fine(Rl,Sl) 

Rl"2 /7hv_fine(Rl r 


grs(Rl,SlS2S3T) 



Figure 4.11: The final Petri net. 
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algorithm discussed before. 

We can find the view position of S2SZT at the very beginning and store this 
position, at the same time, we can generate the free motion plan for the free robot, 
and then use the arm camera to find the precise position and store it. In this way, 
when RlSl state is reached, we can directly generate both free- motion and fine- 
motion plan without the error recovery loop. Execution of the long loop will be 
avoided. 

It is quite complex to verify the properties of the final net. However, if we 
loosen the definitions of reversibility and add stronger constraints on searching feasi- 
ble sequences as described below, we still obtain the properties of liveness, safeness, 
and reversibility for the final net through the decomposition theorems described 
above. 

First, the final net is live. As we see from Figure 4.10, if we have a token 
in A, B, and Z2(if there is no token in R, we can follow an additional sequence to 
obtain a token in R ), from the results of simulation on GSPN, we could ultimately 
get a token in AB. For each PLAN decomposition in the net, we can obtain a 
similar result. Therefore, the net is live. Secondly, when we search a new system 
state, any place obtaining more than one token will be considered as containing 
one token. Therefore, no state will have a marking in any place containing a value 
other than 0 or 1. Any sequence of transitions will not destroy the property of 
1-boundedness and safeness. Thirdly, to investigate the property of reversibility, 
if we ignore the tokens in the places only for planning such as VIEW-POSl(B) 
and VIEW.POS2(B), we can consider the net as a reversible net, because once 
VIEW.POSl(B) or VIEW.POS2(B) gets a token, it will not lose it. However, as 
we showed in the proof of liveness above, if A, B, and R have a token initially(Figure 
4.10), a token will be finally obtained by AB, and R will retain its token. The case 
is similar for other transitions. The net is thus reversible, if we assume the values in 
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some places of the marking are don’t care conditions for the property of reversibility. 

4.6 Simulation Results and Discussions 

Successive decomposition of the Level 0 Petri net using the algorithms dis- 
cussed above yields the PN2 shown in Figure 4.11. The search algorithm may be 
used on the Petri net at each level to identify feasible sequences. All feasible se- 
quences may be obtained for each level and the relationships between the sequences 
at different levels can be studied. At the lowest Level 2, there are greater conflicts 
and constraints among the shared resources. Normally, we cannot expect a shortest 
lower level sequence to be obtained via the decomposition of the shortest sequence 
generated from the higher level representation. 

We list the practical feasible sequences generated at each level of the Petri net 
as follows(we assume no transition is fired more than once): 

Level 0. Petri net in Figure 4.3: 

The number of feasible states: 5. 

The number of feasible sequences: 1. 

Feasible sequence: tl t3 t6 t8. 

Level 1. Petri net in Figure 4.5: 

The number of feasible states: 10. 

The number of feasible sequences: 1. 

Feasible sequence: 

Move(Rl, Si); 

Grasp(Rl, SI); 

Move_Comp(RlSl, H); 

Move(RlSl, Temp_Pos(RlSl)); 

Move(RlSl, S2S3T); 

Move_Comp(RlSl, S2S3T); 
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UnGrasp(Rl, S1S2S3T); 

Move(Rl, Init_Pos(Rl)). 

Level 2. Petri net in Figure 4.6(Motion decomposition): 

The number of feasible states: 15. 

The number of feasible sequences: 1. 

Feasible sequence: 

Move_Free(Rl, App_Pos(H)); 

Move_Fine(Rl, Grasp_Pos(Sl)); 

Grasp(Rl, Si); 

Move_Comp(RlSl, H); 

Move_Fine(RlSl, Temp_Pos(RlSl)); 

Move_Free(RlSl, Temp-Pos(RlSl)); 

Move_Free(RlSl, App_Pos(S2S3T)); 

Move_Fine(RlSl, Ins_Pos(S2S3T)); 

Move_Comp(RlSl, S2S3T); 

UnGrasp(Rl, S1S2S3T); 

Move_Fine(Rl, Init_Pos(Rl)); 

Move_Free(Rl, Init_Pos(Rl)). 

Level 2. Petri net in Figure 4.9(Adding C2 and PLANs): 

The number of feasible states: 15. 

The number of feasible sequences: 1. 

Feasible sequence: the same as that in the above decomposition. 
Level 2. Petri net in Figure 4.11 (Generating PLANs): 

The number of feasible states: 142. 

The number of feasible sequences: 1. 

Feasible sequence: 

Find_Pose(S2S3T, Cl, Pos(S2S3T)); 
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Plan.Path(Rl, View_Pos(N)); 

Move_Free(Rl, View_Pos(N)); 

Find_Pose(N, C2, Pos(N)); 

Move _Free(Rl, App_Pos(H)); 

Move_Fine(Rl, Grasp.pos(Sl)); 

Grasp(Rl, Si); 

Move_Comp(RlSl, H); 

Move_Fine(RlSl, Temp_Pos(RlSl)); 

Move_Free(RlSl, Temp_Pos(RlSl)); 

Plan_Path(RlSl, App_Pos(S2S3T)); 

MoveJFree(RlSl, App_Pos(S2S3T)); 

Plan_Path(RlSl, Ins_Pos(S2S3T)); 

Move_Fine(RlSl, Ins_Pos(S2S3T)); 

Move_Comp(RlSl, S2S3T); 

UnGrasp(Rl, S1S2S3T); 

Move_Fine(Rl, Init-Pos(Rl)); 

Move_Free(Rl, Init_Pos(Rl)). 

For most applications, more than one feasible sequence may be generated 
and an evaluation and selection strategy is used to choose among them. Normally, 
searching sequences from higher level representations may be performed to verify 
the correctness of decomposition and the final net is searched to generate a final 
task sequence. 

The assumption of firing any transition at most once is useful to constrain 
the creation of the shortest sequences. If, under this assumption, we cannot reach 
the final state, a looser assumption of firing each transition at most twice could 
be introduced. Alternatively, the shortest sequence which has the least conflict on 
resources and the least probability of firing any error recovery subsequence could be 


95 


used. 

As can be seen from the simulation results, the shortest sequence from the 
lowest level of decomposition of the representation of task sequences could not be 
obtained via the decomposition of preferred higher level sequences directly. An 
intuitive observation of this fact is shown where a sensor is used on the active 
component, the robot. In this case, a resource conflict appears. For example, when 
a robot is required to pick up a strut on a table and transfer it to a holder, the 
robot first moves to and near the strut on the table. The grasp planner for the 
robot might require the exact position of the strut, and if a camera is mounted on 
the robot arm, it could directly perform sensing operations and no error recovery 
procedure is involved. If we use the decomposition on the representation rather than 
on the sequences, a shortest sequence will be guaranteed to be found on the final 
stage decomposition and the conflicts on resources will be automatically reduced to 
a minimum. 

Another issue we may want to consider is whether our representation includes 
the possibility of parallel operations or concurrency. Two types of concurrency, 
parallel and sequential mutual exclusions for Petri net modeling of manufacturing 
systems with shared resources are discussed in [124]. In Figure 4.11, we can find: (1) 
the transitions, find.vPos( connected with Cl) and mv.free(Rl,Sl) are two parallel 
operations without resource conflict; (2) after find.vPos( same as above) is fired, 
plan.patl i(connected with FREE.PLAN(R)) and mv_free(Rl,Sl ) are two parallel 
mutually exclusive operations with shared resource R.1; (3) if there are two tokens 
in S2S3T and SlH with different colors, sequential mutual exclusions with shared 
resource Rl appear. In this case, after Rl moves to one S2S3T and uses its camera 
to sense the insertion position of the subassembly S2S3 , two choices for the following 
execution should be selected. The first choice may be continuing to grasp an Si on 
a holder H and complete the assembly of S1S2S3. Another choice may be to sense 
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another S2S3 on the second table. The resource conflict for Rl also appears at 
this time. Notice in this discussion the property of 1-boundedness is generalized to 
^-boundedness, where k = 2. 

4.7 Conclusions 

In the above simulations, it is assumed that no transition will be fired more 
than one time. In this example, the number of sequences generated is 1 for all 
the decomposition levels. This is because most transitions in the Petri net for this 
example are essential. The probability of selecting alternative partial sequences or 
transitions is therefore very small. If we suppose some transitions can be fired two 
or more times, the simulations show that the number of feasible sequences will be 
dramatically increased and it will be very costly to store all sequences and compare 
different sequences among them. Under any condition, the sequence found for the 
final net for the example is the shortest and thus most economical to implement. 

The verification of property inheritance during decompositions for assembly 
tasks has been developed. We have shown that the Petri net mapped from the 
AND/OR net guarantees safeness, 1-boundedness, liveness, and reversibility. Based 
on these conditions, the properties of all lower levels of net representations are 
discussed. Because those properties are not lost during specific decompositions, we 
can guarantee a deadlock-free and fault tolerant system. 

An important topic for continued research is how to make the property of 
reversibility on the final net stronger. If all places in the final net are taken into 
account, can the initial state be reached when an error occurs? A related topic is to 
guarantee state reservations for all waiting components or component groups during 
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CHAPTER 5 

REPRESENTATION AND ANALYSIS OF UNCERTAINTY USING 

FUZZY PETRI NETS 


This chapter proposes a generalized definition of the fuzzy Petri net(FPN) and the 
reasoning structures of transitions in the FPN. Three types of fuzzy variables: lo- 
cal fuzzy variables, fuzzy marking variables, and global fuzzy variables, are used to 
model uncertainty based on different aspects of fuzzy information. A fuzzy Petri net 
is used to model the incomplete, uncertain, and approximate information associated 
with firing of transitions and changing of states in robotics and manufacturing sys- 
tems. Using FPNs to model a system, a fuzzy reasoning strategy may be used to 
infer new fuzzy values in output places after the corresponding enabled transition 
is fired. A global fuzzy variable is used to sequence operations with key precedence 
relations for a manufacturing system. A local fuzzy variable is used to represent 
the uncertainty in local configuration variables of the system and may be used to 
control on-line reasoning about sensor-based execution. Several basic types of fuzzy 
Petri nets are analyzed, and the necessary and/or sufficient conditions of safeness, 
liveness, and reversibility are given. An example of modeling sensory transitions in 
a robotic system is discussed to illustrate reasoning about input local fuzzy variables 
to obtain mutually exclusive tokens in the output places. 

5.1 Introduction 

While Petri nets[84, 89] have been widely used to model computer systems[79, 
81, 93], manufacturing systems[2, 116, 125], robotic systems[10, 11, 12, 13, 14, 15], 
knowledge-based systems[8, 52], and other kinds of engineering applications, they 
may be unable to model incomplete, uncertain, and approximate information or 
states. An operation and its preconditions and postconditions in a manufacturing 
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system can be represented by a transition and its input places and output places 
in a Petri net model. Each token in some place of an ordinary Petri net is used 
to represent an entity, such as an object or an abstract piece of information. How- 
ever, a real system may contain objects which require associated variables to fully 
represent an object state. In addition, the values of those associated variables and 
the occurrence of the event itself may be uncertain. In such a system the decisions 
which choose from enabled transitions as well as the generation of a next-step state 
are based on these approximate descriptions of objects. 

Because of the necessity of modeling and representation of lower level oper- 
ations and objects in a robot system[15, 19], ordinary Petri nets are found not 
sufficient to represent uncertainty and approximate information. The uncertainty 
in a robotic system may occur due to many factors during the execution of a planned 
sequence or program. When an operation such as ‘the gripper A grasps the object 
B’, is modeled by a transition in a Petri net N, one kind of uncertainty within 
this grasping operation is the geometric uncertainty in the coordinate of the grasp 
position or the contacting position of the gripper with the object. Because this 
position is important for the succeeding operations of the robot gripper such as mo- 
tion, force control, and assembly, we need to represent uncertain information in the 
output place which shows the result of the robotic grasp operation. Another kind of 
uncertainty within this operation is the uncertainty of the success of this operation, 
and the uncertainty of degree completion for the whole task of the robotic system, 
such as assembling a complete set of objects in a certain configuration or reaching 
a final system state. 

Based on the above discussions, a fuzzy Petri net may be used to describe the 
operations and conditions with uncertainty. Uncertain states are associated with 
objects, and transitions are used to model fuzzy operations such that the input 
variables of transitions will be reasoned approximately and efficiently rather than 
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precisely. This approximation or uncertainty is propagated along the net so that a 
predefined transition sequence may be followed as desired, or, if errors accumulate, 
the operations sequence should be stopped so that the error can be detected by the 
system monitor and the correct recovery sequence may be followed to recover to a 
correct system state. Based on extensions to the theory of ordinary Petri nets, a 
definition of the fuzzy Petri net and the associated embedded reasoning structure 
was presented in [17, 18, 22]. This definition was used to model a sensor-based 
robotic system which incorporates reactive, uncertain, and dynamic properties. 

One example of the utility of using fuzzy concepts to deal with information is 
found in knowledge based systems with uncertainty. When this type of system is 
modeled by Petri nets, the assumption of token values in the net to be 0 or 1, is not 
sufficient to describe the reasoning process or to represent the degree of uncertainty 
of facts. An example for robotic systems is based on our observations that the 
properties of some objects in an assembly or material handling system may be 
changed[12, 14], so that the same place may contain different kinds of tokens during 
different processing times. The properties of objects may be physical or geometric 
characteristics which are parameterized to define the objects. In this case, it is hard 
to use the same crisp value to represent the tokens in different processing states. 

Since its emergence in 1965, fuzzy sets[119] have been applied in many aspects 
of engineering systems, decision systems, medical systems, industry, transportation, 
and other applications. Numerous papers have been published in ail aspects of 
the theory of fuzzy sets, fuzzy mathematics, and their applications. Our reasoning 
strategy in fuzzy Petri nets is based on the the theory of fuzzy logic, and the firing 
of transitions is equivalent to the operations on membership functions in a certain 
universe of discourse. A membership function for a fuzzy set A is defined by 
X — ► [0,1], where a distribution of membership grades for each element in a 
universe of discourse is given. A fuzzy singleton is defined as a membership function 
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in a universe of discourse, of which the membership grades of all elements are Os, 
except one and only one element, x, of which the membership grade is 1. We mark 
the fuzzy value of this membership function as x. 

In this chapter, we propose a generalized definition of a fuzzy Petri net and a 
complete reasoning structure associated with a transition in the net. This definition 
can be used in many applications of FPNs such as sequencing, planning, reasoning 
about uncertainty, process control, and knowledge inference. Two kinds of important 
planning strategies, off-line sequencing for task sequences, and on-line sensing and 
react ively reasoning about firing sequences, are shown to be effectively solvable by 
FPNs. We use local fuzzy variables to model the information which locally affects an 
operation, and we use fuzzy marking variables to represent the state of the system. 
The main differences between an ordinary Petri net and a fuzzy Petri net are the 
fuzzy values associated with places and tokens, and the reasoning rules which govern 
the firing of transitions. For an ordinary Petri net, a transition is fired if all input 
places contain at least one token. For a fuzzy Petri net, the condition of firing is 
also based on the local fuzzy variables associated with input places. Using a fuzzy 
Petri net to represent a robotic or manufacturing system, we are able to handle 
approximate information or uncertainty in the system. The reasoning about this 
information is incorporated into the firing rules of transitions. 

In the definition of a fuzzy Petri net, local fuzzy variables, fuzzy marking 
variables, and global fuzzy variables were defined as different fuzzy information 
carried through the net. In [12, 20], global fuzzy variables were used to model 
the degree of completion of the robotic task so that an operations sequence could 
be planned off-line while searching in the fuzzy Petri net model. Compared with 
the strategy used in ordinary Petri nets, computational time and space are saved 
because when the order of key transitions are given, all planned sequences should 
imply this order. Therefore, a correct sequence is defined as a feasible, complete, 
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and correctly ordered sequence. Any sequence which fails in satisfying this definition 
is discarded during the off-line searching process. In [14, 21], local fuzzy variables 
and global fuzzy variables are used simultaneously to model sensor-based robot task 
sequence planning and the execution of operations involving the use of sensory data. 
During the execution of a robot operations sequence, sensory operations can detect 
the partial result of some key operations on-line and the accumulation of errors will 
cause a local error recovery sequence or a global error recovery sequence. The local 
fuzzy variables decide the choice of error recovery strategy. 

Previous work on predicate/transition nets has described approaches to han- 
dling predicate related expressions[39, 42]. Tokens in predicate/transition nets can 
be structured objects carrying values, and transition firing can be controlled by im- 
posing conditions on the token values. Predicate/transition nets have been used for 
the management of expert systems, analysis in database systems, and many other ap- 
plications. Research on colored Petri nets[54] reports related results though enabling 
limited reasoning capacity. The major difference between the predicate/transition 
net or the colored Petri net and the fuzzy Petri net is that a fuzzy Petri net can 
represent more generalized data using fuzzy numbers and fuzzy reasoning functions. 
The results of firing on some transition will depend not only on the input values, 
but also on a reasoning process built in the transitions. The transition firing may 
depend on the local fuzzy variable or the global marking based on different appli- 
cations. The strategy of property analysis on predicate/transition nets thus cannot 
be directly applied to the fuzzy Petri net. 

Investigation of the properties of fuzzy Petri nets is very important for perfor- 
mance evaluation of a system being modeled. Reachability is a fundamental problem 
in the research on ordinary Petri nets. The reachability problem on fuzzy Petri nets 
is also defined on a feasible reachable set from an initial state. The reachability 
problem can influence other properties such as liveness, safeness, and reversibility. 
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Safeness of fuzzy Petri nets is defined under the assumption that no more than one 
copy of a single object appears in the system. Liveness of a fuzzy Petri net implies 
that the reasoning process or the execution process can continue when the accumula- 
tion of errors is still within a range of tolerance, and when errors go over a threshold, 
an alternative sequence can be chosen in place of the original sequence. Reversibility 
implies that at any time if errors are too large, a home state is reachable. 

The discussions on fuzzy Petri nets in this chapter are arranged as follows: In 
Section 5.2, the fuzzy Petri net definition is introduced and some components of this 
definition are explained. A system state represented by fuzzy information is then 
discussed in Section 5.3. Section 5.4 shows reasoning rules in the FPN. Section 5.5 
gives analysis for some basic cases. FPNs for sequencing and FPNs for sensing are 
discussed in Sections 5.6 and 5.7, respectively. In Section 5.7, sensing operations 
are modeled as mutually exclusive transitions in a fuzzy Petri net and therefore 
reasoning on sensory data can be performed in these transitions. The conclusions 
are given in the last section. 

5.2 Fuzzy Petri Nets 

The definition of the generalized fuzzy Petri net is shown as follows[17, 18]: 
Definition 5.1 A fuzzy Petri net is formally defined as an 8-tuple: 

FPN = (P, T, Q t , a, 0, m f , m t , p f ), 


where 

1) P = {pi, p 2 , . . . , p„} is a finite set of places, n > 0. 

2) T = {t\, ti, ■ ■ ■ , f m } is a finite set of transitions, m > 0. Pf]T = 0. 

3) Q t = {<?!, <72) . . . , <7 j) is a finite set of state tokens, l > 0. 

a C {P x T} is the input function, a set of directed arcs from places to 

transitions. We call each p, where (p, , tj ) 6 a as an input place of tj. 



103 


5) 0 C { T x P] is the output function, a set of directed arcs from transitions 
to places. We call each p, where ( tj,pi ) € ft as an output place of tj. 

6) mj : P — *■ {(p, p)} assigns pi the value of a 2-tuple, (p, g), where p repre- 
sents the local fuzzy variable and q represents the fuzzy marking variable. 

7) m t : Qt — > C} is a mapping from a token to a union of 2-tuples 

of ki and the kith, global fuzzy variable, <7^, or, to a constant, C , which indicates 
no global fuzzy variable is attached to the token. <r k , is a membership function in 
a universe of discourse. 

8) p s : T -» {fuh, • ■ • i fm} is an association function, a mapping from transi- 
tions to corresponding reasoning functions. A reasoning function /; maps variables 
associated with input places and a set of tokens to variables associated with output 
places and another set of tokens. 

If we denote the reasoning function for a transition ti as firing of f, when it 
is enabled will map (p, g) from all input places to all output places and assign <7 to 
output tokens. /, has at most three kinds of rules for mapping p, g , and a. They are 
written as r p , r e , and tv, respectively. These rules may or may not be independent, 
and after firing ti, the original (p, g) may or may not stay in input places of t x . 

If a place p, represents an object 0„ then the local fuzzy variable associated 
with it can be represented as p(p t ); the fuzzy marking variable associated with it can 
be represented as p(pi)l and the fc,th global fuzzy variable within this place can be 
represented as where gj occupies p, in the current state. In this chapter, we 

assume p(pi), p(p«)? aQ d <7jt, (<7j) a re independent, i.e., one variable cannot be inferred 
from any of two others. When the fuzzy Petri net model is generated, we may assign 
a priori local fuzzy variables to all places. Thus, even though a place contains no 
token, the object it represents still has a local fuzzy variable. If we consider the 
three types of variables for a set of places, p Jt , pj 3 , . . ., Pj w , we can write them as 

p(Pjj ? Ph j • • • i Piw ) = (p(Pji )’ P(Ph )’ ' ' ' 1 P(Pjw ))• 
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&(Pn > Ph » ■ ■ • > Pjw ) — ( 8(Pji )i p(Ph )’ ■ • • * SiPjv))- 

{<lj[ » 9jji • • • » = (^(9ij)> )»••■» ^ki(9ii,))j 

where <fy, q#, . . q jL occupy p h , p j2 , . . p ju) , respectively. 

Pictorially, each place p, is represented by a circle with “p,” and a label which 
indicates the object pi represents attached to it, and each transition t : is represented 
by a rectangle with %•” and “/>” attached to it. If (p, •,*,•) € a, there is a directed 
arc from p, to t y If ( t : , p, ) € /?, there is a directed arc from tj to p,. 

The interpretation of a ‘token’ in a place depends on rn/(p,) = (p(p,), p(p,)). 
From the above definition, three different types of variables are operated on or 
carried along through the net. The three types of fuzzy variables have different 
interpretations: 

A local fuzzy variable is attached to a place. Its value indicates the 
uncertainty of the local variable or object which is attached to the place. 

It is represented by an n dimensional membership distribution function 
on the assumption that the object is n dimensional. One example is 
to define p(R ) for the robot R. Because R has 6 degrees of freedom(3 
for position and 3 for orientation), p{R ) is a 6 dimensional membership 
function. The membership grades are defined for each possible position 
and orientation of the gripper in a given universe of discourse. 

A fuzzy marking variable is attached to a place. It is a 1 dimen- 
sional membership distribution function denoting the uncertainty that 
a token exists in a given place. The universe of discourse for g is the 
occurrence of the event denoted by the place. In one example, the place 
may indicate the event that the robot has grasped an object. The fuzzy 
marking variable indicates the uncertainty that the event has occurred, 
i.e., whether the robot is actually holding the object. 
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Figure 5.1: A robotic system for a grasp task. The robot(/?) moves to the strut(S) 
on the table and grasps it. (a) shows the initial state for this task. R has 6 degrees of 
freedom for the position and orientation of the gripper, (x,y, z, <f>,u>, xf). 5 is defined 
by the position of its center and the angle between 5 and the x' axis, (x',y',0). (b) 
shows the final state of this task. RS is described by x", the distance between the 
grasping point and 0", the center point of S, under the assumption that the grasp 
position will be on the strut. 

A global fuzzy variable is attached to a token. This is an m dimen- 
sional membership distribution function related to a characteristic vari- 
able of a global task. The global fuzzy variable may be used to sequence 
a set of transitions so that a global task can be completed. An example 
is the use of a global fuzzy variable to represent ‘degree of completion’ of 
a task. The fuzzy value should increase during the execution to indicate 
correct sequencing of operations. 

Figure 5.1 shows an example of a robot assembly task which illustrates these 
three types of fuzzy variables. This robotic system consists of a robot(f?) and a 
strut(T) on a table. The robot gripper(i?) moves to and grasps the strut(5) on the 
table, and this grasping state is described as RS. Figure 5.1(a) and Figure 5.1(b) 
illustrate the system state before and after the ‘grasp’ operation. 

This assembly task can be represented by a fuzzy Petri net shown in Figure 5.2. 
Pi»P 2 , P 3 and p 4 represent the configurations /t 0 , 5, R C S, and R c , respectively. In this 
representation, R 0 and R c means the robot gripper is open or closed, respectively. 
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Figure 5.2: The fuzzy Petri net representation for the robotic assembly task shown 
in Figure 5.1. (a) shows the initial state of the system, (b) shows the final state 
of the system. R 0 and R c means the robot gripper is open or closed, respectively. 
p, g, and a of R 0 and S in (a) are mapped by fi to those of R C S, R c , and S 
in (b). Note that the same color of tokens in pi in (a) and in pz and p 4 in (b) 
indicates that a global fuzzy variable is attached to these tokens. Their colors are 
different from that of the token in p 2 in (a) and (b). The fuzzy marking variable 
g defines alternative output states R C S or i? c , 5. The global fuzzy values might 
be <j(R 0 ) = 0, cr(R c S) = 1, cr(R c ) = 0. The local fuzzy variable p describes the 
positional uncertainties of the robot and object in terms of their fuzzy membership 
functions. 

p{R 0 ) and p(R c ) are 6-D membership functions representing the uncertainty in the 
robot position. p(S) is a 3-D membership function representing the uncertainty 
in the position of the strut on the table. p(R c S ) is a 1-D membership function 
with parameter x" which represents the uncertainty in the grasp point along the 
strut. We assume g(pi) for this example is a fuzzy singleton, which describes the 
uncertainty of event completion. For example, in Figure 5.1(a), g(R 0 , S, R C S, R c ) = 
(1,1, 0,0), and in Figure 5.1(b), g(R 0 ,S,R c S,R c ) = (0,0.1, 0.9, 0.1). If the token 
which represents an entity containing R carries a global fuzzy variable indicating 
the degree of completion of the task and under the assumption of m t (qj) as a fuzzy 
singleton, then in Figure 5.2(a), cr(R 0 ) = 0, and in Figure 5.2(b), a(R c S) = 1, 

a(R c ) = 0. 

As with other Petri net models, we would like to use the fuzzy Petri net 
to analyze properties such as reachability, liveness, safeness, and reversibility. We 
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define the reachable set of a fuzzy Petri net as the set of markings(consisting of fuzzy 
marking variables) reachable from the initial marking after all feasible transition 
sequences are fired. While it is complicated to analyze the properties of a fuzzy 
Petri net with all three types of fuzzy variables, some basic cases can be treated to 
yield useful properties. For an ordinary Petri net, all useful properties are defined 
based upon the markings on the net. The fuzzy Petri net model adds the complexity 
of local and global variables which must be considered. In this analysis, we will 
consider first the problem where only local fuzzy variables exist in the fuzzy Petri 
net model. 

There may be three different cases according to the above assumptions. First, 
firing rules follow from the ordinary Petri net, and local fuzzy variables are un- 
changed. Second, firing rules follow from the ordinary Petri net, and local fuzzy 
variables axe changed. Third, firing rules are conditional upon input variables, and 
local fuzzy variables are changed. The analysis for these three cases will be discussed 
in Section 5.5. 

5.3 State Representation of an FPN Model 

Because there are three different kinds of variables associated with places and 
tokens in the FPN, three different system states are defined and given below. In 
these definitions, places are considered as parameters of system states, and from a 
place, we can find the corresponding attached local and global variables. 

Definition 5.2 Local fuzzy state Si: Si(pi,p 2 , ■ ■ ■ ,p n ) = {p(pi) , p(P 2 ) , ■ ■ • , p{Pn)) , 
an n-tuple of local fuzzy variables in the FPN. p(p,) is either a membership function 
in a universe of discourse, if this information is available, or, e, if this information 
is not available. 

Definition 5.3 Fuzzy marking state S m :S m (pi,p 2 ,. . p„) = (e(pi),e(P2)i • • •> £(/>«))> 
an n-tuple of fuzzy marking variables in the FPN. p(p,) is a membership function 
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in a universe of discourse. 

Definition 5.4 Global fuzzy state S g : S g (pi,P 2 , ■ ■ ■ , Pn) = (cr(pi ), cr(p 2 ) > • • • ,v{Pn)), 
an n-tuple of global fuzzy variables in the FPN. <r(p,) is either a value of a token if 
this token is existing, m t {q : ), or, e, indicating that no such information is available. 

For the system state shown in Figure 5.2(a), Si(R 0 , 5, R C S, R c ) = (p(R 0 ), p(S), 
e, e); S m (R 0 , S,R C S,R C ) = (1, 1,0,0); and S g (R 0 ,S,R c S,R c ) = (0 ,C,e,e). For the 
system state shown in Figure 5.2(b), Si(R 0 , S, R C S, R c ) = (e, p(S), p(R c S), p(R c ))', 
S m (R 0 ,S,R c S, R c ) = (0,0.1, 0.9, 0.1); and S g (R 0 ,S,R c S,R c ) = {e,C, 1,0). 


5.4 Reasoning Rules in the FPN 


Three types of reasoning rules for fi of a transition t, in the FPN model are 
represented as rjf, , and r‘j. Specifically, we assume U has k input places which 
correspond to k vaxiables, p,-, , p,- 2 , ..., p, k , at time N. And, t, has t output places 
which correspond to t variables, p,< , p,-» , . . ., p,j, at time N + 1. Therefore, 


r'jigip '\P),e(Pi!P),-' 




^)) - (^r i) )’^r i) )’-’^r +i) ))- 

■,<?(pi? } )) = (< +i) )^(pr ) ),..^(pr , )>- 


(5.1) 

(5.2) 

(5.3) 


In using r p during firing of f,-, the values of p contained in all input places are 
evaluated and t{ generates the values of p for all output places. The other two kinds 
of reasoning rules are used in a similar way. The selection of reasoning strategies 
for rules, such as using a rule base or functional relationships, is based on different 
applications. The choice of whether to destroy the original values may also depend 
on the specific application. In principle, these rules may be further generalized to 
model interactions among the three types of fuzzy variables. For purposes of analysis 
here, we will not consider those cases. 
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Figure 5.3: The input local variables and output local variables for a transition 
of Case 1. Before ti is fired, p, u contains a token, 1 < u < k. After t , is fired, pi< v 
obtains a token, 1 < v < s. All local fuzzy variables for this case are fixed. 

In the FPN shown in Figure 5.2, the state changes are implemented by t j which 
consists of r* 1 , r* 1 , and r^ 1 . These rules can be shown as: r t p 1 (p(Ri N ^), p(S^)) = 

(p(S^ N+ %p(RcS^^),p(R { c N+1) )); r*‘(l, 1) = (0.1, 0.9, 0.1); and r*‘(0,C) = (C, 1,0). 

5.5 Property Analysis for Several Basic Cases with Local Fuzzy Vari- 
ables 

Figure 5.3 shows a transition ti in the net which has k input places corre- 
sponding to k variables, pi x , p^, , . . ., p 1J( . ti has s output places which correspond to 
s variables, p,-» , p,j, . . ., p,;. The corresponding local fuzzy variables are represented 
as p fI , p <4 , ..., p ik and p,», p^, . . ., p,-«. For the sake of simplicity, we draw one- 
dimensional membership functions to represent all these variables. The membership 
functions for p^^ ( 1 < v < s) prior to marking, may be thought of either as the func- 
tion which existed from the previous marking, or as an a priori function assigned 
to the place. Transition has a reasoning function Two types of reasoning rules 


no 


for /,, r** and r‘*, are used for the following discussions. 


5.5.1 Case 1: Local Fuzzy Variables Unmodified by Transitions 


Case 1 can be described by two conditions: (1) p(pj) = Cj, 1 < j < n and Cj 
is a fixed membership function; (2) for some transition f t , all input places have at 
least one token at time N, i.e., g(p\\p) > 1 , 1 < u < k. 

If the above two conditions are satisfied, then ti is enabled. The resulting rule 
r' 1 can be written as 


rf (?( pf’). M"') «0O) = (Afc;), A(p,;),. . . , A ( RI )), 




,(*) 


and 

A(p,;) = l, l<v<s. 

Then we can obtain g for each output place as 

+1) ) = eiPi^) + A(p t ;), l < v < s. 

and 

^(p!f +1) ) = eip^) - i, i < « < k. 

The membership functions for all local fuzzy variables are represented by the solid 
curves in Figure 5.3, and these curves are unchangeable when the system is executed. 

Therefore, each time when we reach and fire transition f t , we expect the same 
input local variables and output local variables and the output marking only depends 
on the input marking of f,. This case can be considered as the same as the ordinary 
Petri net firing mechanism, with associated fixed local fuzzy variables. The following 
properties can be seen for this type of FPN. 


Theorem 5.1 Assume a fuzzy Petri net of Case 1 is mapped from an ordinary Petri 
net by assigning to each place a fixed local fuzzy variable, and assume the reasoning 
function is the same firing rule as in ordinary Petri nets. The resulting fuzzy Petri 
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net is live, safe, and/or reversible if and only if the original Petri net is live, safe, 
and/or reversible. 

Proof: All these properties are dependent upon the firing mechanisms of transi- 
tions in the net. Because the enabling conditions of transitions only depend on the 
markings of input places, the properties of liveness, safeness, and reversibility are 
unchanged while the fuzzy Petri net is mapped from an ordinary Petri net or the 
fuzzy Petri net is mapped back to the ordinary Petri net. 

Q.E.D. □ 


5.5.2 Case 2: Local Fuzzy Variables Modified by Transitions 

Case 2 can be described by two conditions: (1) The output local variables of 
a transition t, may be changed after is fired, i.e., 

r'M^\ • • • . *c» = «pr ,, MC ,) >> ■ ■ ■ • 

where N and N + 1 represent the different time slots before and after U is fired; 
(2) for some transition f,, all input places have at least one token at time N , i.e., 

ftf?!"’) > li I < » < t. 

If the above two conditions are satisfied, then fj is enabled. The resulting rule 
r*’ can be written as 

rj (f>(pi, N) ), s(pS, W| ), .... PtpL" 1 )) - (Afo; ). Afe. ), .... A(p,, )). 

Similarly, 

s(pf +,) ) = p(pL N) ) + A (Pi;), A(p,.; ) = 1, and 1 < o < ». 


and 


p(p‘r +,) ) = *dD - 1. 


1 < u < k. 


The membership functions of all local fuzzy variables are represented by dotted 
curves in Figure 5.4. These curves may be changed during the execution of the 
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Figure 5.4: The input local variables and output local variables for a transition t, 
of Case 2. Before f, is fired, p, u contains a token, l < u < k. After t, is fired, 
Pi> v obtains a token, 1 < v < s. The output local fuzzy variables for this case are 
changed. 

system. The generation of the output local variables are dependent on the input 
local variables and the rule r*\ 

Case 2 is more general than Case 1. For the robotic assembly task in Figure 
5.1, Case 1 fixes the uncertainty associated with each place, and thus the errors this 
case can model are very limited. For case 2, the configuration R C S depends not only 
on transition ti but also the initial configuration p(R 0 ) and p(S). The following 
properties can be found for this type of fuzzy Petri net. 

Theorem 5.2 Suppose a fuzzy Petri net is mapped from an ordinary Petri net by 
assigning to each place a changeable local fuzzy variable and the reasoning functions 
are the same as the firing strategy as defined in ordinary Petri nets. The resulting 
fuzzy Petri net is live, safe, and/or reversible if and only if the original Petri net is 
live, safe, and/or reversible. 

Proof: The proof is similar to Theorem 5.1 because the changeable local fuzzy 
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variables still have no influence on deciding the marking of the net. 


Q.E.D. □ 


5.5.3 Case 3: Transition Firing Depends on Input Local Fuzzy Variables 

Case 3 can be described by two conditions: (1) The output local variables of 
a transition may be changed after i, is fired, i.e., 


r p mT). . p(pD) = (Kp)f +i o, P(pir +, o, . . . , p(/>r i, ))> 


J. N h\ - 






AN+lh 


where N and N + 1 represent the different time slots before and after t, is fired; 
(2) for some transition ti, all input places have at least one token at time N, i.e., 
e(p!„ N) ) > 1, 1 < # < t. 

If the above two conditions are satisfied, then t,* is enabled. If we fire ii, then 


r ff'(e(Pif /) ).?(Pir ) ).---^(Pir , )'P(p<r , )>p(Pir , )----'P(Pir j )) = (Afp,-), a(p, a^)), 


ji»h 


n W\ 




-W 


_ 


and 

A(p tt )€{ 0,1}, l<u<s. 

Then we can obtain g for each output place as 


p(pir +i) ) = p(p!r') + AM’ i < u < 

and 

?(p!. w+i) ) = eti?) - 1. i <u < k. 

The membership functions of all local fuzzy variables are represented by dotted 
curves in Figure 5.5. These curves may change during the execution of the system. 

For this case, the output local fuzzy variables are dependent on input local 
fuzzy variables and the fuzzy reasoning rules, and the output markings after t{ 
is fired are dependent upon the input local fuzzy variables, the input markings, 
and the firing functions. Therefore, even if all input places have tokens, after t, is 
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Figure 5.5: The input local variables and output local variables for a transition i, 
of Case 3. Before t, is fired, p, u contains a token, 1 < u < k. After t t is fired, some 
Pi^ obtain a token, 1 < v < s. The output local fuzzy variables for this case are 
changed. 

fired, it does not necessarily guarantee that all output places get more tokens. One 
application of this type of fuzzy Petri net is sensor-based selection for on-line robotic 
operations. After a sensor is used to verify a system state, the following operation 
may be local error recovery, global error recovery, or continuation of the execution 
of the planned task sequence, all of which depend on the token in one output place 
of a sensing transition. 

The properties of this type of fuzzy Petri net are not provable in general 
because of different reasoning strategies which decide the availability of tokens in 
output places dependent upon input local fuzzy variables and the rule r‘\ Some 
useful subclasses of this case are worthwhile to investigate. We first give the following 
definition: 

Definition 5.5 A mutually exclusive transition f,: (1) if p^, p,- , . . ., and p,v are s 
output places of t,; (2) After t{ is fired, A(f>(p t >)) = 1 or A (f>(p,')) = 0, 1 < j < s, 
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and V = Uj{p.-j : A(<?(p.')) = 1},V = U ,{p,; = A(f>(p.;)) = 0}; (3) V # 0, ^ # 0, 
Pfll>' = 0, andPUP' = Uj =1 {p,;}. 

The following theorem provides the condition for safeness for a class of fuzzy 
Petri nets. 

Theorem 5.3 Suppose a fuzzy Petri net is mapped from an ordinary Petri net 
by assigning each place a changeable local fuzzy variable. The reasoning functions 
and the input local fuzzy variables decide the output marking and the output local 
fuzzy variables. If one and only one mutually exclusive transition t, exists in the 
net and other transitions satisfy the conditions described in Case 1 or Case 2, and 
the original Petri net is safe, the resulting fuzzy Petri net is also safe. 

Proof: Because after f, is fired, not all output places will receive tokens, therefore, 
for any following transition sequences, the places in the net will get fewer or the 
same number of tokens as in the ordinary Petri net. The resulting fuzzy Petri net 
will be safe if the original ordinary Petri net is safe. 

Q.E.D. □ 

Definition 5.6 MEO( mutually exclusive output ) subsets of a mutually exclusive 
transition t,-: For all feasible transition sequences from the initial marking and for all 
possible input local fuzzy variables available for f,, we assume there are L different 
partitions of the set of the output places of f,: T>\, T> 2, . . ., T>i. If the following 
conditions are satisfied: (1) Vi(\'Dj = 0 , 17^ j and 1 < i,j < L; (2) U1L1 = 
U*=i p.' / ( 3 ) At any time after t{ is fired, A(p,^ ) = 1, for all pi> v € Vj and A (p,' v ) = 0 
for all pi' v £ 'Dj, 1 < v < s and 1 < j < L, then T>\, T>2, . . ., T>i are called MEO 
subsets of t{. 


Figure 5.6 shows a mutually exclusive transition with four output places and 
four examples of possible output markings. Figure 5.6(a), 5 . 6 (b), and 5.6(c) show 
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/Subset l\ 






Subset f n n 



(b) MEO subsets: Subset 1, 2, and 3. 


' N 



(d) Non-MEO subsets. 


Figure 5.6: Some examples of MEO subsets for a mutually exclusive transition with 
four output places. 
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MEO subsets. In Figure 5.6(a), L = 2, V\ = {p3,P4}> V 2 = {ps,P6}, which indicates 
that sometimes after t x is fired, g(p 3) = £>(^4) = 1> and p(ps) = pipe) = 0, and 
sometimes g{ps) = g{pe) = 1 and gipj) = p(p4) = 0- No other possibilities may 
appear for g. In Figure 5.6(b), L = 3, V\ = {P3}, D> 2 = {P4,Ps}, and D 2 = {pe}> 
and in Figure 5.6(c), L = 2, V x = {p3,P6}? & n d D 2 = {P4>P5}- Figure 5.6(d) shows 
non -MEO subsets where p(p 4 ) = 1, g{ps) = 1 and p(p3) = 1, p(P4) = 1 are both 
possible after firing f,. The following theorems define a class of fuzzy Petri nets 
which guarantee the properties of liveness, safeness, and reversibility. 

Before we discuss the following theorem, we give definitions of the addition of 
two Petri nets and subtraction of a subnet from a Petri net. Similar operations on 
Petri nets are used in synthesis techniques of Petri nets[53]. 

Definition 5.7 The addition( u +”) of a net N\ = fl\) and a net N 2 = 

{P 2 ,T 2 ,a 2 ,0 2 ): Nr + N 2 = {P x (jP 2 ,Tr \JT 2 ,ct,0) where a = ^{(p,',*;)}, € 

aiU«2, and 0 = Uj{( f j>P.)}- (*j>Pi) € /?iU/?2- 

Definition 5.8 The subtraction(“-”) of a subnet N' = (P',T r , ot',0') from a Petri 
net N = (P,T,a,0): N - N' = (P - P'J - T',a",/3"), where a" = Uo{(Pi,*i)}, 
(Piitj) e a, 0" = U, •;{(*;,*)}, € 0, and p, € P - P' , tj € T - T. 

Theorem 5.4 If a fuzzy Petri net is obtained in the same way as described in 
Theorem 5.3, and t, has MEO subsets 'Dr, D 2 , . . ., Dl, and the following conditions 
are satisfied: (1) there exist L number of subnets Mr, M 2 , . . ., Ml, and Mi contains 
V if 1 < t < L; (2) N - (Ef=i Ni-Nr), N- (ELi M - N 2 ), (£f =1 N, - N L ) 

are live; (3) N, f\Nj = 0, i ± j and 1 < i,j < L. Then this fuzzy Petri net is also 
live. 

Proof: Suppose at any time when t x is fired, the places in Dr always obtain tokens, 
then N - (£f =1 N - Nr) is live. In other words, the transitions contained in N - 
(ZLi N, — Nr) are live. Similarly, if we assume Dj is always guaranteed to obtain 
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Figure 5 . 7 : A fuzzy Petri net with one mutually exclusive transition t\. After t\ is 
fired, P2 and pj or p 4 will receive the tokens based on the local variable available in 
Pi and r* 1 . 

tokens after is fired, then the transitions in N — (££_ x iV,- — Nj) are live. Because 
after t{ is fired, all Vj may contain tokens, therefore, all transitions in the net are 
live. The fuzzy Petri net satisfying the above conditions is thus live. 

Q.E.D. □ 

An example for a fuzzy Petri net with one mutually exclusive transition t x and 
MEO subsets V\ = {p2,P3} and X > 2 = {p 4 } is shown in Figure 5 . 7 . The subnet N\ has 
the following structure: P x = {p2,P3,P5,Pe}, T x = {^2,^3}, Qi = {(pj,*a), (f3, *3)}, 
Pi — {(ti,ps), (^3,P6)}- The subnet N2 has the following structure: P 2 = {PiiPi}i 
T2 = {<4}, 02 = {(P4iM}) and 02 — {(^4tPr)}- contains T>\ and N2 contains X>2- 
From Theorem 5 . 4 , we can prove that this fuzzy Petri net is live. 

The property of reversibility is important for modeling error recovery strategy 
using Petri nets. When a fuzzy Petri net is used, reversibility implies that the 
marking is restored for the initial state, and some local fuzzy variables may be 
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changed. The following theorem proposes the condition for a fuzzy Petri net to be 
reversible. 

Theorem 5.5 If a fuzzy Petri net is obtained in the same way as described in 
Theorem 5.4 except that subnets N — — Ni), 1 < / < L, may or may 

not be live, N - (Ef=, N, - Ni), N - (£f =1 N { - jV 2 ), (Ef =1 N x - N L ) are 

reversible, and Ni, N 2 , . .., Ni contain no token in the initial marking, then this 
fuzzy Petri net is also reversible. 

Proof: The proof is straightforward following the same strategy as discussed in 
Theorem 5.4. 

Q.E.D. □ 

If there are more than one mutually exclusive transition, U IX f, 2 , . . ti T , existing 
in the fuzzy Petri net, we can generalize the above discussions to the following 
corollaries: 

Corollary 5.1 Suppose a fuzzy Petri net is mapped from an ordinary Petri net by 
assigning each place a changeable local fuzzy variable. The reasoning functions and 
the input local fuzzy variables decide the output marking and the output local fuzzy 
variables. If more than one mutually exclusive transition, , f,- 2 , . . ., exists in 
the net and the original Petri net is safe, the resulting fuzzy Petri net is also safe. 

Corollary 5.2 If a fuzzy Petri net is obtained in the same way as described in 
Corollary 5.1, and £j u (l < u < r) has MEO subsets A U1 , A UJ , • And 

the following conditions are satisfied: (1) there exist ul number of subnets N, , 
N i« 3 > •••> Ni, L and N i} contain £>,,, «i < j < n L ; (2) N - (E“= u , ~ 

N - (E“= U1 Ni, ~ NiJ, N - (E“4 uj N tj - N iuL ) are live; (3) N ip f]N iq = 0, 
p ^ q and U\ < p,q < ul, then this fuzzy Petri net is also live. 
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Corollary 5.3 If a fuzzy Petri net is obtained in the same way as described in 
Corollary 5.2 except that the subnets JV-(£“= u, V tj -V„), u x <l<u L may or may 
not be live. N - (££ Ul Nj - N til{ ), N - (£&* Nj - N ilt2 N - (E“=u, ~^u L ) 
are reversible, and iV,-,, Nl» contain no token in the initial marking, then 

this fuzzy Petri net is also reversible. 

5.6 FPNs with Global Fuzzy Variables: Example of Task Sequencing 

An application of FPNs has been discussed for the task sequencing problem[12, 
20]. When a robotic assembly system is modeled by a fuzzy Petri net, all feasible op- 
erations in the system are represented by transitions, and all possible objects, such 
as components, devices, subassemblies, and assemblies are represented by places. 
Given an initial marking and an expected final marking, a task sequence planning 
problem is equivalent to the problem of sequencing transitions, which usually oc- 
curs in an off-line mode. In this approach a global fuzzy variable is introduced to 
represent ‘degree of completion’ of the task while maintaining the precedence of key 
operations (‘key transitions’). 

A reachability strategy[16, 89] can be used to search for sequences in an or- 
dinary Petri net. For sequencing transitions, while maintaining precedence among 
those properties that are changed during the process, a prime number marking al- 
gorithm was proposedf 12, 14, 20, 21] to generate global fuzzy values of a variable 
<j(pi) such that precedence is preserved. In this case, the fuzziness of the net only 
shows up in tokens, not places. 

In the example shown in Figure 5.2, if we assume this net is an FPN carrying 
cr, the initial marking using a values is S g = (0, C, e, e), and the final marking 
is S g = (e, C, 1,0). Places p x , p 3 , and p 4 contain the same kind of token, which 
indicates whether the task is completed, but with different values, 0 and 1. 

For other examples, there may be k colors of tokens, c x , c 2 , . . ., c*. For 
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color c,, an independent subsequence for reaching the global task is <«, , t, 2 , . . ti n< • 
The transitions in this subsequence may not be a consecutively enabled transition 
sequence. However, to correctly execute the global task, all subsequences should 
be completely executed with a correct order. When using this strategy to search 
or plan a transition sequence from the net, time and space will be saved compared 
with the methods used in ordinary Petri nets. 

5.7 FPNs with Local Fuzzy Variables: Examples of Robotic Sensing 
5.7.1 Local Fuzzy Variable for Sensor-Based Error Recovery 

Figure 5.8 shows the example of local fuzzy variables for the robotic system 
from Figure 5.1. The position of the strut on the table is represented by a fuzzy 
variable p(S). The position of the robot gripper is represented by a fuzzy variable 

p(R). 

Figure 5.8(a) is a correct positioning of RS, but in Figure 5.8(b), an incorrect 
configuration is shown. This information of the real state of RS is not known prior 
to execution and a sensor will be used on-line to verify the state. 

We assume the next operation of the robot is f 2 , a move operation, as shown in 
Figure 5.9 (this is a simplified extension of Figure 5.2 because we omit the possibility 
of t\ resulting in R c and S, and we don’t distinguish R c and R 0 . This simplifica- 
tion can also be implemented by using a sensor after t\, so that there will be no 
vagueness between R C S and S, R c after t\ is fired.). This may fail if the robot is 
not holding anything. An appropriate decision should be made to evoke an error 
recovery sequence in case the grasp operation fails. 

We assume the membership function for p(RS) is a 2-D membership function 
as shown in Figure 5.10. To separate the 2-D membership function into two possible 
future executions, move or error recovery, we use a sensing operation to verify the 
state after the grasp operation is done. A sensor separates the 1-D membership 











Figure 5.9: A FPN representation for a grasp and move operation for the robot. 
RS' is a specified state the move operation is supposed to reach. 



Figure 5.10: A distribution for the membership grades of the position the robot 
gripper reaches to grasp the strut. The darkened curve is a 1-D membership function 
where the robot is assumed to reach the strut. 
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Figure 5.11: A modified FPN which includes an error recovery sequence. If the 
sensed value does not fall near the x" axis, an “ungrasp” transition, for a robot to 
move to another temporary position(not necessarily the original position) and then 
grasp the strut again, is fired. Note that grasp* may not be the same as grasp. The 
error recovery sequence is initiated by the fuzzy reasoning rule in / 2 attached to 
transition i 2 . 

function from a 2-D membership function as shown in Figure 5.10. If y" « 0, 
the ‘darkened’ membership function describes the resulting uncertainty in x" of 
the grasped strut. If y" ^ 0, an error recovery sequence should be followed to 
disassemble RS. The fuzzy reasoning rules at t 2 models the resulting decisions. 
On-line execution with an actual sensor value requires a fuzzy control decision rule 
which executes the appropriate sequence. A modified fuzzy Petri net based on the 
above discussion is shown in Figure 5.11. The error recovery sequence is initiated 
by the fuzzy reasoning rule in / 2 attached to transition f 2 . 

5.7.2 Modeling Sensing Operations as Mutually Exclusive Transitions 

During the execution of a robotic system modeled by a fuzzy Petri net, the 
exact positions of the arm or the state of the object being processed are never 
known exactly because of the approximation of the controller and the uncertain 
environment. A sensor or multiple sensors are used to verify and validate on-line 
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approximate information so that the whole operations space can be divided into 
several mutually exclusive ranges. Sensors may also have errors and approximation 
and fuzzy reasoning rules can be used to reduce the fuzziness caused by uncertainty 
of the partial results. The fuzzy marking variables and the output local fuzzy 
variables are obtained through reasoning at the sensory transition. 

The fuzzy Petri net corresponding to a mutually exclusive transition 1 1 with 
three output places is shown in Figure 5.12. t\ is modeled as a virtual sensory 
transition which will verify the state of p\ and obtain the corresponding output 
mutually exclusively. From this example, we see that when a local fuzzy variable in 
Pi is obtained, it is input into t\ for reasoning about the token in an output place. 
The reasoning function r* 1 consists of three steps: (1) intersect input fuzzy variables 
with the expected membership function residing in pi and obtain the intersection 
area or the highest membership degree, (2) intersect input fuzzy variables with the 
expected membership function residing in pz and obtain the intersection area or the 
highest membership degree, (3) intersect input fuzzy variables with the expected 
membership function residing in p\ and obtain the intersection area or the highest 
membership degree. Then, from these three partial results, we can get a maximum 
value corresponding to a certain place p,-, 2 < i < 4. In this example, pz has 
the maximum intersection area as shown by the shaded area in Figure 5.12(a). 
Therefore, a token is put in pz after the reasoning process ends as shown in Figure 
5.12(b). 

In a real system, a sensing operation may direct the following transition se- 
quences to continue the execution, locally recover from an error if that error is 
locally recoverable, or globally recover from an error if that error is not locally re- 
coverable. Each sensing operation is a mutually exclusive transition, and its output 
places constitute MEO subsets. 


126 



P2 



Figure 5.12: Fuzzy reasoning in a fuzzy Petri net for obtaining a token in an output 
place mutually exclusively. 
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5.8 Conclusions 

In this chapter, we have proposed a generalized definition of the fuzzy Petri net 
using three different types of fuzzy variables: local fuzzy variables, fuzzy marking 
variables, and global fuzzy variables. Local fuzzy variables are examined in detail, 
and are used to reason about parameters associated with places. Fuzzy Petri nets 
are shown to have advantages over ordinary Petri nets to model a system which has 
vague, random, and approximate information. Sensors can be used to handle uncer- 
tainty of occurrence of events and reduce the dimension of membership distribution. 
Sensor-based verification for states and sensor-based error recovery strategies can 
be incorporated into the FPN model of the system. FPNs are also shown to be a 
good model for off-line sequencing and on-line reasoning about execution. 

Properties of these nets have been defined for specific cases of interest. An 
example of the application of these properties is modeling and analysis of a sensor- 
based robotic system. Uncertain sensory input data can be handled and sensory 
transitions may be modeled as mutually exclusive transitions. Only a subset of the 
output places can receive tokens after the transition is fired, the other places will 
not receive any tokens. 

Fuzzy values as defined here are membership functions in a certain universe of 
uncertainty. Sometimes, we may want to know the crisp values for some tokens or 
the crisp state of the system. In this case, a fuzzy defuzzifier[63, 64] is necessary to 
defuzzify the fuzzy values before it is output to the controller. Similarly, the input 
values to the FPN model may also be crisp values, and a fuzzifier[63, 64] is needed 
to turn crisp values to fuzzy values. Also, different reasoning strategies may be used 
for different transitions in the net. 

Fuzzy Petri nets are potentially useful to model many different types of dis- 
crete event systems with uncertainty. Global fuzzy variables may be used to plan 
operations sequences for robotic or manufacturing systems. Local fuzzy variables 
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may be used to reason about sensor-based error recovery sequences. Fuzzy marking 
variables impose probabilistic conditions on the system marking. The interrelation- 
ship among these fuzzy variables is a topic which leads to additional research issues. 
In practice, other forms of non-fuzzy probabilistic reasoning could be used within 
this framework. 

An important issue related to this research is the choice of rules for transitions. 
Experiments can be done to learn rules. A fuzzy Petri net will be robust only after 
many experiments and modifications of the reasoning structures. A neural network 
may be useful to represent these firing rules. This research also has important 
implications for knowledge representation, knowledge reasoning, modeling of expert 
systems, and other AI applications. 



CHAPTER 6 

TASK SEQUENCE PLANNING USING FUZZY PETRI NETS 

This chapter discusses the problem of representation and planning of operations 
sequences in a robotic system using fuzzy Petri raefs[12, 17, 18]. In the fuzzy Petri net 
representation, objects whose internal states are altered during a process are termed 
‘soft’ objects, and the process steps where alterations may occur are labeled ‘key’ 
transitions. A correct sequence is defined as a sequence which is feasible, complete, 
and satisfies precedence relations. In this formulation, the internal state of an object 
is represented by a global fuzzy variable attached to the token related to the degree 
of completion’ of the process. All correct operations sequences must satisfy process 
sequence constraints imposed by fuzzy transition rules. The correct precedence 
relationships and the characteristics of completeness for operations in all feasible 
sequences are guaranteed by the prime number marking algorithm which marks 
the fuzzy Petri net. The use of fuzzy transition rules in this application simplifies 
the representation and search problems for task planning where correct sequences 
do not depend on exact knowledge of internal states, but only their precedence 
relations. 

6.1 Introduction 

The objective of task sequence planning for a robotic workcell or manufacturing 
system is to efficiently represent all feasible and complete task sequences with correct 
precedence relations and to be able to choose among them. A sequence of the 
shortest length or other optimality criterion may be selected from these correct 
sequences. In previous work[U, 13, 15], it has been shown that the AND/OR net 
representation of an assembly system may be mapped to an ordinary Petri net with 
specific properties such as safeness, 1-boundedness, liveness, and reversibility. In 
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this chapter, we introduce a fuzzy Petri net mapping instead of the ordinary Petri 
net mapping to represent a system which includes some soft objects , e.g., objects 
which change their internal states during the task. A state of the system is thus 
composed of a set of membership functions for the completion of the global task 
on all feasible objects. Fuzzy transition rules implement the sequencing constraints 
required to direct the process to the final global state of the system. 

AND/OR graphs[47, 48] have been used in assembly task planning to represent 
and search all possible assembly sequences. The AND/OR net[ll, 13, 15] extends 
the AND/OR graph representation to incorporate system mechanisms and devices, 
and defines an Internal State Transition(lST ) operation which modifies the internal 
state of an object. The AND/OR net is generated based on the descriptions of 
objects and all feasible geometric relationships among them, and it is used to plan 
operations sequences for geometric manipulations including assembly, disassembly, 
grasping, and robot motions. In [11, 16], we showed that an AND/OR net could be 
mapped to a Petri net, and this Petri net can then be decomposed to lower level 
nets[13, 15, 19] while retaining properties of liveness, 1-boundedness, safeness, and 
reversibility. 

In this chapter, we expand the domain of the Petri net mapping as a rep- 
resentation of a robotic workcell, by defining fuzzy internal states of objects and 
using fuzzy transition rules in the Petri net to impose precedence constraints on key 
operations. 

An object in the system is defined as a single component, a subassembly of 
several components, or a complete assembly. A soft object is defined to be an object 
which includes at least one internal state variable. Similarly, a hard object is defined 
to be an object which is not a soft object. In this chapter, the internal state variables 
of soft objects are described by fuzzy values of tokens, and a prime number marking 
algorithm is used to map an ordinary Petri net to a fuzzy Petri net in a manner which 
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guarantees consistent sequencing of operations. In the resulting fuzzy Petri net, each 
transition has an associated fuzzy reasoning rule and an associated weighting factor 
which evaluate the resulting values in the output places of this transition based on 
the fuzzy values of tokens in its input places. Transitions which cause the changes 
of fuzzy values of tokens for objects, are defined as key transitions and must be 
included into all feasible and complete task sequences. 

One difficult problem in choosing feasible task sequences is to order the cor- 
rect precedence relationships among all important events or transitions. Using prime 
number marking in modeling the system, the weighting factors as well as the initial 
tokens and final tokens are chosen for all soft objects and hard objects so that an 
assigned precedence relationship will be automatically followed, and all sequences 
which incorporate incorrect precedence relationships will be recognized and dis- 
carded. The prime token values of soft objects can be interpreted as the degrees of 
certainty of completion for these objects. 

In our recent work[17], a definition of the generalized fuzzy Petri net was 
given which incorporated three types of fuzzy variables: local fuzzy variables, fuzzy 
marking variables, and global fuzzy variables. Property analysis associated with 
some typical cases of fuzzy Petri nets wa s given[l8]. In this chapter, we use the 
fuzzy Petri net model which carries only global fuzzy variables for task planning, 
and use it to represent and reason about all feasible, complete, and correctly ordered 
task sequences for a robot workcell. 

6.2 State Representation for Task Sequences 

A robotic or automated manufacturing system consists of many different kinds 
of components such as robots, sensors, fixtures, handling mechanisms, and parts. 
Different tasks may be assigned to and accomplished by the system. All devices must 
be coordinated to insure successful completion of a task goal through a sequence of 
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feasible operations. This on-line coordination may be managed by a subset of the 
system Petri net which couples transitions to on-line execution of desired operations. 

From the task sequence planning point of view, the system must follow a 
partially ordered sequence of intermediate states to reach from the initial state to 
the final state[48], where state is defined as the vector of the states for all components 
in the system. We assume a system consists of n components C \ , C 2 , . . C n , where 
Ci represents the ith component. We use sj(Ci) to represent the state of component 
Ci at time j, where we also assume a discrete time representation and j is thus 
zero or a natural number. For the moment, we assume that each component may 
occupy a fixed number of feasible states in the range 0 to N{. The integer vector 
representation for the state of the system is = ( 5 i(Ci) s j(Cn)) T , 

0 < j < M, and M • f 1 is the maximum number of all feasible states the system 
may occupy. In this approach, a partially ordered list of state vectors may be used 
to represent a task sequence. 

An alternative representation for the task sequence is based on the defini- 
tion of specific types of state transitions. An operator will change the state of 
the system by making a set of components change from one substate to another 
substate , where a substate is defined as Sij = (sj(C Pl ) Sj{C n ) ... Sj(C pt )) T and 
{si(C Pl ), s : (C n ), Sj (C p ,)} C {sj(Ci), s,(C 2 ), ..., *;(<?„)}. We introduce the 
concept of substate because many tasks may be thought of as functioning on several 
objects, i.e., a subset of the objects in the system. Three kinds of tasks, 7\, T 2 , and 
T3, are defined as follows: 

(1) Assembly: One set of components or subassemblies are combined with or 
put in geometric contact with one or more other sets of components or subassemblies. 

Ti(0,j, ..., = C i2 , (6.1) 

where 


Oi, = {Cf* 1 , cl'*', .... c£>}, 
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Oi k Q {c n , C n , . .., Cj,), 1 < k < u, and, 

Oi kl f]O iki = 0, l<*i,* 2 <«. 

(2) Disassembly: A subassembly or assembly is separated into a set of compo- 
nents or subassemblies. 

C,- 2 , C, t }) = {Ojj, — , Oj,}, (6-2) 

where 

0, k = {C, ( ">, Cj" 1 , .... C<">}. 

£ {C„, Ci„ .... C,-,}, 1 <k<l, and, 

(3) Internal State Transition: The internal state of a set of components is 
modified by changing the internal state of a single component in this set, or by 
changing the relative geometric positions among the components of an assembly, or 
by modifying a property of a single component in a compact set of components. 

T: i(0,) = 0„ (6.3) 

where 


o,-MCn). *(G»). • ••. *«U *<Cw.) »«?<«.). .... 


0,-WCfc). .... /(Ci.), s'(C, Vl ), .... s(C„)), 


0 ,- 0 , = wc„), 3 (C„ +1 ), 

0, - o, = K(C„), S '(C„„), 


As the number and complexity of the system substates and their interactions 
increases, the task representation may be further simplified by defining a geometric 
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state vector, which separates geometric state relations from internal state variables of 
individual objects. The geometric state vector is a binary vector where the elements 
represent all feasible geometric states which can occur during the process. Using 
this representation, a set of mathematical functions can be defined for task planning 
and execution, and transitions from one system state to another system state may 
be defined based upon the properties of vectors. For each single component C t , the 
corresponding element state is e, = s(Ci) and for each feasible set of components 
Ci t , C, 2 , ..., Ci m , the corresponding element state is e, = s({Ci 1 , Ci 2 ,. . . , C, m }). 
The geometric state vector is thus (75 = (e\ e? . . . e n ) T where e, is either 0 or 1. 
This vector occupies the same dimension for the same system at any time. We will 
show in the following discussion how this representation can be generalized to a 
vector of token values which carries the degrees of completion for the global task. 

Figure 6.1 shows an example of a robotic system with two parts, one robot, 
and two processing machines. In this system, the robot prepares and then inserts 
the peg cylinder(P) into the hollow cylinder(C) to form a new cylinder assembly. 
In one feasible, complete, and correctly ordered sequence, the robot first picks up 
the raw peg cylinder, moves it to the cutting machine for cutting, then transfers 
it to the lubricating station prior to insertion. The corresponding AND/OR net 
representation for this system is shown in Figure 6.2. 

In this AND/OR net, we use AND arcs to represent all feasible assembly or 
disassembly operations. For example, RPC is connected with PC and R by an 
AND arc, which means RPC can be disassembled to PC and R , and PC and R can 
be assembled and form RPC . An internal state transition operation is represented 
by a thick line connecting two corresponding nodes in the AND/OR net. The off- 
line and on-line selection of the assembly, disassembly, or internal state transition 
operation is based on the system state, i.e., the matching of the precondition of 
each operation with all element states. AND/OR nets display ail feasible objects 



Figure 6.1: A peg-cylinder assembly system. 



Figure 6.2: The AND/OR net representation for the peg-cylinder assembly system. 
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Figure 6.3: The ordinary Petri net mapped from the AND/OR net in Figure 6.2. 

and all possible geometric relations among objects, and the geometric constraints 
among on-line operations. The Petri net mapped from the AND/OR net [11] for this 
example is illustrated in Figure 6.3. The mapping is based on an algorithm which 
decomposes each axe in the AND/OR net to two transitions in opposite directions 
based on feasibility criteria. The resulting Petri nets guarantee the properties of live- 
ness, 1-boundedness, safeness, and reversibility under the assumption of transition 
feasibility. 

The geometric state vector for this assembly scenario is 
££ = ( s(R ) s(P) s(C ) s(L ) s{M) s(RP) s{PC) s(RPC) s(RPL) s(RPM) s{LUB) s{CUT)) t . 

The value for any element is either 1 or 0 which corresponds to whether a single 
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component or subassembly is existing in the system at this time. Many different 
operations sequences could be searched from this Petri net task representation. If 
we give this Petri net an initial state vector (1 1 1 1 1000000 0) and a 
final state vector (1 0011010000 0), a sequence which is ti(R, P — ► RP ), 
tx 2 (RP,C — ► RPC), tiz(RPC —* R,PC ), will be selected as the shortest sequence 
from all possible sequences. This sequence is actually not a complete sequence 
because it just picks up the raw peg and inserts it into the hollow cylinder. A 
new strategy will be necessary to generate only feasible and complete sequences 
which satisfy the ordered process constraints. Any feasible sequence must include 
the partial ordering: CUT — ► LUB — * INSERT. The next section introduces 
an approach to fuzzy marking of the net which implements this process sequencing 
constraint. In this example, one internal state variable for the peg is its diameter. 
During the cutting operation, this parameter will be changed. The other internal 
state variable is the surface lubricating state of the peg. These internal states will 
be mapped to a global fuzzy variable membership function and carried by the tokens 
flowing in the net. 

6.3 Fuzzy Sets for Modeling System State 

Fuzzy set theory[119] has been applied to fuzzy production rules[86], fuzzy 
control[72], fuzzy expert systems[65], sensor fusion[107], pattern recognition[57], 
and other interesting areas. Fuzzy logic and its applications provide an effective 
means of capturing the approximate, inexact nature of the real world. In this chap- 
ter, this methodology is used to describe the imprecise characteristics of processing 
and assembling operations in a robotic assembly or material handling system. The 
use of fuzzy reasoning rules in this application simplifies the representation and 
search problems for task planning where correct sequences do not depend on exact 
knowledge of internal states, but only their precedence relations. 
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6.3.1 Fuzzy Sets 

Fuzzy sets have been used as a broad conceptual framework for dealing with 
uncertainty and information. For the universe of discourse .Y, which contains all 
the possible elements of concern for a particular application, the crisp set is defined 
to dichotomize X to two groups: members(those that belong to a subset A) and 
nonmembers(those that certainly do not). Because of vagueness in dividing members 
of the class from nonmembers, a fuzzy set is introduced by assigning to each possible 
individual in X a value representing its grade of membership in the set. For a 
garment handling robotic system[9, 101, 102], during the process of turning a piece 
of cloth into a pair of trousers, the grade of membership of the object, trousers, 
would gradually increase. Therefore, this grade corresponds to the degree to which 
the partial product of trousers is similar to the concept of the trousers. Larger values 
denote higher degrees of membership of the system object. A global fuzzy state of 
the system is thus defined as a mapping from the objects in the system to a set 
of membership functions defined for each object, or subsets of objects. The formal 
definition of the global fuzzy state will be discussed in the following subsection. 

In a manufacturing system, ‘degree of completion’ is one such membership 
function which characterizes the objects in the system which will be discussed in 
this chapter. Other such global membership functions might be test validation which 
would monitor the mutual functional suitability of a set of components as they move 
through a process, or tolerance compatibility which would track tolerance relations 
as the process proceeds. 

For a robot or manufacturing system, the crisp universal set .Y of objects that 
we have defined is X = {0 X , 0 2 , • • • , O n }. The global fuzzy variable membership 
value corresponding to each object or set of objects is V = {u(0i), v(02), ■ • • , u(O n ), 
. . . ,v(Oi , Oj , .}, where v(Ok) is e if no token is available for Ok- Following a 
certain operations sequence, after the system has been working 1 time unit, 2 time 
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units, and so on, the global fuzzy states will be labeled as Vi, V 2 , . . ., V m . The 
support of a fuzzy set A in the universal set X is the crisp set that contains all the 
elements of X that have a nonzero membership grade in A, which corresponds to a 
set of all existing objects with token values not equal to 0 in the system. An a-cut 
of a fuzzy set A is a crisp set A a that contains all the elements of the universal 
set X that have a membership grade in A greater than or equal to the specified 
value of a, i.e., A a = {x € X|s(a:) > a}, where s(x) is used here to represent the 
grade of membership. The set of all levels a 6 [0, 1] that represent distinct a-cuts 
of a given fuzzy set A is called a level set of A. Therefore, = {a|s(x) = a for 
some x € X}, where denote the level set of fuzzy set A defined on X. Finally, 
the scalar cardinality of a fuzzy set A is defined on membership grades of all the 
elements of X in A. Thus |A| = Ergx 3 i x )- For the set of objects in the systems 
considered here, the scalar cardinality is changing throughout the processing because 
the number and values of tokens are changing when the task is executed. 

6.3.2 Fuzzy Petri net 

In [17, 18], we proposed the definition of the generalized fuzzy Petri net which 
includes three types of fuzzy variables: local fuzzy variable, fuzzy marking variables, 
and global fuzzy variables. Local fuzzy variables are used to model the uncertainty 
of the local variables(‘internal state’) of objects; fuzzy marking variables are used to 
indicate the uncertainty that events have occurred; and global fuzzy variables are 
used to represent the characteristic variables of the global task. In this chapter, 
since we discuss the task sequencing of operations sequences, only global fuzzy 
variables are used to model the degrees of completion for different global subtasks. 
Therefore, the following presentation of the definition of the fuzzy Petri net only 
includes global fuzzy variables. The task sequencing problem is solved by imposing 
numerical constraints incorporated in the token values in the places. Similarly, the 
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fuzzy transition functions defined in the net also operate on the values carried by 
tokens. 

Definition 6 . 1/1 fuzzy Petri net(FPN) with global fuzzy variables is defined as an 
8 -tuple: 

FPN = (P, T, Q t , /„, a, jS, m t , p/), 

where 

1) P = {p x , p 2 , . . . , p n } is a finite set of places, n > 0. 

2) T = {ti, f 2 , ■ • • i tnj } is a finite set of transitions, m > 0. Pf\T = 0. 

3) Q t = {( 71 , q 2 , . . . , qi } is a finite set of state tokens, l > 0. 

4) I v s is a set of internal state variables which are associated 

with corresponding objects or places. This mapping can be described a s P —* I v . 
Global fuzzy variables are modified by changing internal state variables when the 
net is executed. 

5) a C {P x T} is the input function, a set of directed arcs from places to 
transitions. We call each p, where {pi,tf) € ct as an input place of tj. 

6)0C{T x P} is the output function, a set of directed arcs from transitions 

to places. We call each p,- where ( tj,pi ) € /? as an output place of tj. 

7) m t : Q t —* {U«(£«> ^k.), C} is a mapping from a token to a union of 2 -tuples 
of k{ and the k,th global fuzzy variable, (7k, , or, to a constant, C, which indicates no 
global fuzzy variable is attached to the token. < 7 *. is a membership function in a 
universe of discourse. In the following discussion we will often refer to the value of 
the global fuzzy variable as the ‘token value’. 

8) pj: T — ► {/i, fi, • • • , fm} is an association function, a mapping from tran- 
sitions to corresponding reasoning functions. A reasoning function /, maps a set of 
tokens in input places to another set of tokens in output places. 

In this chapter, global fuzzy state S g , which was defined in Section 5.3, is used 
to model a system state. <r(pi) is written as a 1 . 
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In the following discussion, each token, or group of tokens, will map to a 
value, [0,1], of each fuzzy membership function with which it is associated. In 
this sense, the universe of discourse of the fuzzy set includes the prior and current 
system states(markings and internal states). The reasoning functions associated 
with the transitions, update the fuzzy membership values as the net executes. For 
the example of peg-cylinder assembly (Figure 6.1), we define key variables associated 
with cutting, lubricating, and inserting of the peg. A simplified view of the resulting 
fuzzy membership function is shown schematically in Figure 6.4. The horizontal axes 
show the partial internal states represented by cutting and lubrication, while the 
vertical axis indicates the degree of membership in the fuzzy set task completion. 
Clearly the task is not ready for completion without both cutting and lubrication, 
and cutting to a specific diameter should precede lubrication. Figure 6.4 shows 
these conceptual relations, while, in practice, these mappings are carried out by the 
reasoning functions attached to the FPN transitions. 

A transition in a fuzzy Petri net may be enabled when the token values of 
its input places satisfy some specified fuzzy reasoning rule. For example, one such 
reasoning rule for assembly requires the token values of all objects to be assembled 
have values not less than a value 6 , and therefore be members of a designated level 
set. If a transition is chosen to fire, all tokens in the input places are removed and 
fuzzy tokens are added to its output places, which may contain values different from 
the input values. The values of new tokens will depend on the fuzzy reasoning rule 
of the transition. 

For the three types of transitions, assembly, disassembly, and 1ST operations 
described in Section 6.2, we can define the following fuzzy transition rules. Initially, 
we assume only one soft component exists in the system. Therefore, we may use 
only < 7 j to represent ), 35 indicated in the FPN definition, and C — I. The 

case of multiple soft components will be discussed in a later section. Each fuzzy 


142 



Internal State Variable ’CUT’ 

Figure 6.4: Conceptual diagram of the fuzzy membership function for the global 
fuzzy variable ‘task completion’ in the peg-cylinder assembly task. The horizontal 
axes are internal state variables for ‘cutting’ and ‘lubrication’, and axe not a com- 
plete state description. In practice, this membership function is executed using a 
transition reasoning function. 
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Figure 6.5: Fuzzy Petri net representation for assembly transition. 


transition/reasoning function is defined by an integer, which is called a weighting 
factor, WF, In practice, the weighting factors and the thresholds are adjusted 
to define appropriate level sets for the transitions sequences. WF is defined as 
T — ► {1, 2, 3, . . .}, a mapping from transitions to integer values. 

Assembly operation: 0,j, 0,,, . . . , 0i„ — ► 0j. The fuzzy Petri net correspond- 
ing to the assembly operation is shown in Figure 6.5. 

if . . ,cr‘“) > 9, then a 3 = mm(<7 ,1 ,<7 ,s , . . . ,<r' u ) x WF k - (6.4) 

Disassembly operation: 0; — ♦ 0 ;i , Oj 2 , ..., 0j r The fuzzy Petri net corre- 
sponding to the disassembly operation is shown in Figure 6.6. 

if a' > 9 , then a 3i = &' x WFk * soft(Oj d ) + 1 — soft(Oj d ), (6-5) 


soft(Oj d ) = 


1 < d < l 


where 

1 if 0j d is a soft object, 

0 otherwise, 

1ST operation: 0 P -*■ 0 q . The fuzzy Petri net corresponding to the 1ST 
operation is shown in Figure 6.7. 


if a v > 9 , then <7 q = cr p x WFk- 


( 6 . 6 ) 



(a) Before t fc is fired. (b) After t k is fired 

Figure 6.6: Fuzzy Petri net representation for disassembly transition. 
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6.4 An Algorithm for Assigning Global Fuzzy Variables 

In this section, we propose an algorithm which maps an ordinary Petri net to 
a fuzzy Petri net based on the assumption that a single soft component exists in the 
system, and the precedence of key transitions which modify internal states of the 
objects which include this component are known a priori. 

6.4.1 Prime Number Marking Algorithm 

The prime number marking algorithm is based on the fundamental theorem of 
arithmetic. This algorithm assigns weighting factors to all transitions in the ordi- 
nary Petri net and initial token values to all corresponding places. The fuzzy Petri 
net generated using this algorithm assigns prime numbers to transitions, and these 
may be mapped onto the token values for degrees of completion of the task. We 
call the token values generated by this algorithm prime token values. All feasible 
and complete sequences which contain all key operations to change the properties 
of the soft objects will be found in the fuzzy Petri net. These sequences are also 
guaranteed to have correct precedence relationships among operations. 

Prime Number Marking Algorithm 

Input: an ordinary Petri net mapped from an AND/OR net, the prime number 
table, soft component C , the number of steps for changing properties of C, s. 
Output : a fuzzy Petri net. 

step 1: Initialization. For all transitions ti(l < i < m), the weighting factor of /,*, 
WF t = 1. 

step 2: Pick the first s prime numbers P u P 2 , P s in the prime number table. 

step 3: For all 1ST transitions, pick those transitions which change the properties of 
C, and order them according to the required sequence of operations. Suppose 
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these transitions are t qi , t n , . . . , t q> . 

step 4 : Set WF qi = P u WF qi = P 2 , . . . , WF q , = WF q , = P 3 . 

step 5: Map the initial marking from the original Petri net. For each place pj, 
1 < j set the corresponding token qi to the same value as in the ordinary 
Petri net. If place pj corresponds to an object which represents or contains C , 
select a positive integer T, such that 

0.1 < l(T r x WF qi x WF q2 x ... x WF q < 1.0. (6.7) 

step 6: Change the value of a* to 10 _T . 

Proposition 6.1 After the original Petri net is mapped to the fuzzy Petri net, the 
initial global state for the fuzzy Petri net contains the token values 0 or 1, and the 
prime token value for the soft object is 10 -T . The final global state for the fuzzy 
Petri net contains the token values of 0 or 1, and the prime token value for the soft 
object is 10- T x Pi x P 2 x . . . x P,. 

6.4.2 Interpretation of Prime Token Values 

We assumed initially that only one soft component existed and described 
a global fuzzy values assignment algorithm based on prime number sequences of 
weighting factors. This assignment guarantees the generation of feasible, complete, 
and correctly ordered sequences, and defines a method to describe the degrees of 
completion for soft objects. To understand and interpret the prime token values, 
we convert them to fuzzy values uniformly distributed between 0 and 1 so that the 
resulting token value of the soft object in the final global state is 1. 

The possible prime token values for the soft objects are: 

10 -r , 10 -r x Pi, 10 -r xPixP 2 10 -T x Pi x P 2 x . . . x P 3 , 
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where T satisfies (6.7). In order to map them to the discrete points on a uniformly- 
distributed unit range [0,1], we use x 0 , x l? x 2 , ..., x, to represent these possible 
token values, and we use a function /(x,) to represent the resulting fuzzy values. 
Therefore, /(x 0 ) = 0, and 

f( Xi ) = /(*,■_,) + i = 1,2, ... ,s. 

3 

All feasible fuzzy values here can be considered as the proportions that the first i 
key transitions contribute compared to all s transitions. An interpretation sequence 
can be generated as follows: 0(not yet processed), ^(the first key transition has been 
fired and others have not yet been fired), |(the first two key transitions have been 
fired and others have not yet been fired), . . ., ^-(the first s — 1 key transitions 
have been fired and the last one has not yet been fired), 1 (all key transitions have 
been sequentially fired). With these s + 1 points in a two-dimensional coordinate 
frame, we can obtain an equation for a curve which passes through these points. 
We use Lagrange’s Interpolation Formula[9l] to derive the formula for this equa- 
tion. Lagrange’s Formula is used because Xi +1 — x, is not a constant. Lagrange’s 
Interpolation Formula is: 

,, . _ (z-zt)(z-x 2 )(z-z 3 )...(z-z„) (z-z 0 )(z-z 2 )(z-x 3 )...(z-z n ) 

X (x 0 - Xi)(x 0 - *2)(*0 - X3) ■ • •(*<> - Xn) (*1 “ *o)(*l ~ *2)(*1 ~ *3) • • • (*l “ *n) ^ 

, . (g-go)(x-Xi)(x-X2)...(*-gn-l) .. (({ 

(x n - x 0 )(x n - xj)(x n - x 2 ) . . .(x n - x n _i) 

where (x 0 ,j/o), (*i,yi), (*2,1/2), • • -, (*n,2/n) are points already known. For our 
assumption, the interpolation points tire: (10 _r ,0), (10~ T Pi,^), (10 _r PiP 2 , 7)* 
(10 _t PjP 2 P3, |), ( 10 " t PiP 2 ...P„ 1). For the fuzzy Petri net representation, 

this yields: 

, 1 (» - io- r )(« - io-^A ft )(x - io~ r P» P 2 P 3 ) • - . (x - 10 - r P! ...p,) 

/W a (10- T Pi - 10 - r )( 10 -rp, - lO-rPjPjJjlO-rPi - lO-rPiPiPjJ.-.UO-rp, - 10- T Pi ...P,) 

2 (r - 10~ r )(r - 10-' r Pi )(r - 10~ r P 1 P 2 P 3 ) . . . (x - lQ- r Pi . . . P, ) 

+ 7(10- r PiP 2 - 10- r )(10- r PiP 2 - lO-TPiHlO-TPxPi -10 - t PiP2Pz)...{10- t PiPi - 10- r Pi ...Ps) 

+ ... 

(r - 10-r)(« - 10- r Pi 10- T Pi • ■ . P,-» ) 

+ (10- r Pi ...P, - X0- T ){10- T P 1 ...P,- 10- T Pi)...(10-Tp, ...p, -10-rp, ...P,_,)' 


(6.9) 
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Notice that in the above equation, the first point (10 T ,0) vanishes. We 
suppose x = 10- T x x 1 , then x' = 10 r x x. Therefore, (6.9) is simplified as 


i (g - 1 )(^ - - P1P7P3) . • • (» # - PiPi • • • fi) 

/lXj s (Pi - l)(Pi - PxP 2 )(Pi - P1P2P3) . . . (Pi - PlP 2 . . . P.) 

2 (P-l)(x / -P 1 )(x / -P 1 P 2 P 3 )...(x / -PiP 2 ...P J ) 

+ 5 (Pl P 2 - l)(PiP 2 - Pi)(PiP 2 - P1P2P3) • • • (P1P2 - PlP2 . . • P.) 

, 1 (x--l)(x--P,)...(x'-P,P 2 ...P t -,) 

When we map the prime token values to fuzzy values for each object in the 


representation, we also change the weighting factors of all transitions in the fuzzy 
Petri net so that the sequence of fuzzy values can be obtained using the same fuzzy 
reasoning rules. Suppose there are s key transitions in the system and the initial 
prime token value for the soft object is 10 -7 \ The updated weighting factors for all 
key transitions are: 10 r x £, 2, 3, • • ^33, n^T - The we ighting factors for other 

transitions and the initial global fuzzy state are left as the same. 


In the example of the peg-cylinder assembly system in Section 6.3, the param- 


eters are: s = 2, Pi = 2, P 2 = 3, and T = 1. In this case, (6.10) becomes 


l(x'-l)(x'- 6) 2 (x' - l)(x # - 2) 

2 (2 — 1)(2 — 6 ) + 2 (6 — 1)(6 — 2 ) 


( x ' _ i)( — x ' 4. —) 

in 40 X + 20 


Therefore, 

when x = 0.1, x' — 0.1 x 10 1 — 1, /(x) = 0, 

when x = 0.2, x' = 0.2 x 10 1 = 2, /(x) = 1 x (— ^ + 35) = 0.5, 

when x = 0.6, x' = 0.6 x 10 1 = 6, /(x) = 5 x (— ^ + 35) = 1.0. 

Using the prime number marking algorithm, the ordinary Petri net shown 

in Figure 6.3 can be mapped into a fuzzy Petri net as shown in Figure 6.8. The 
initial global fuzzy state is shown in this net. The soft objects in this example are 
P, RP, RPM , RPL, RPC, PC. The key transitions are < 5 and t 9 . Therefore, 
WF$ — Pi =2 and WFg = P 2 = 3. Because 10 -1 x WP 5 x WFg = 0.6 satisfies 
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(6.7), ( 7 2 of the initial global state is thus 0.1. The token value for place PC in the 
final global state is 0.6. 


6.4.3 Feasible Sequences in the Fuzzy Petri Net 

The following theorem provides a method to use the feasible global fuzzy 
states obtained during the generation of the fuzzy Petri net, to search for feasible, 
complete, and correctly ordered sequences efficiently. 


Theorem 6.1 The Fundamental Theorem of Arithmetic 
If p, and qi are positive primes, and if 


where 


a = IT Pi' = 

*'=i i=i 


1 < Pi < Pi < ■ • ■ < Pn-l < Pn, 


and 


1 < <7i < ?2 < ■ • • < <?m- 1 < 9m i 


then n = m, p, = qi and a, = every positive integer has a composition into 
positive prime factors, which is unique apart from the order of the factors. 


Proof. See [94, p. 263]. 

Theorem 6.2 Using the prime number marking adgorithm, all sequences generated 
from the fuzzy Petri net of which each transition can only be fired at most once, are 
feasible, complete, and hold correct precedence relationships among key transitions, 
if and only if the places corresponding to soft objects can only hold the following 
order of token values: 10 -T , 10 -T x Pj , 10 -t x Pi x P 2 , . . . , 10 -T x Pi x P 2 x . . . x P 3 , 
where Pi, P 2 , . . . , P, are the first s primes. 


Proof. The values of all weighting factors WFi, WF 2 , ..., WF m are 1, Pi, P 2 , 
. . ., P s , 1 < s < m. If the sequences are feasible, all feasible token values are 10 -r , 


I! Hill 
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Figure 6.8: The fuzzy Petri net mapped from the previous ordinary Petri net. 
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10 -T x Pi, 10 ~ T xP 2 , 10 -T x P„ 10 ~ T x Pi x P 2 , 10- T x Px x ... x P„ i.e., 

C 0 + C 1 +C 2 + ... + Cl = 2* possible token values. If the sequences also hold correct 
precedence relationships on key transitions, then the weighting factor of the first key 
transition that the developing sequences meet should be WF\. All possible token 
values are now reduced to 10 _T , 10 -T x P x , 10 -T x x 0 where 0 is a product of at 
most s — 1 elements which do not contain P\ ■ Therefore, if the developing sequences 
meet the second weighting factor which is not equal to 1, all possible token values 
are now reduced to 10 -T , 10 -7 " x Pi, 10 -7, xfix P 2 , 10 -T x Pi x P 2 x 0', where 0' 
is a product of at most s — 2 elements which do not contain P\ and P 2 . Continuing 
this procedure, all possible token values that the developing sequences will meet are: 
10- T , 10 _T x Pi, 10 _r x Pi x P 2 , . . 10" r x P x x P 2 x ... x P„ i.e., s + 1 possible 
states. If the sequences are also complete, the sequence should follow all possible s 
weighting factors which are not equal to 1. Therefore, the sequences will meet all 
possible token values. The necessary part of the theorem is thus proved. 

Suppose the soft objects hold the following sequence of token values: 10 -T , 10 -T 
xP u 10 -T xPiX P 3 , . . . , 10- r xPixP 2 x...xP s . Notice that at this time, we are 
given all results of products. Using Theorem 6.1, we will get unique compositions 
into positive prime factors and 10 -7 \ and then order the prime factors inside the 
form of products. A unique ordered sequence for each token value will be obtained. 
The first value corresponds to firing any number of transitions(with no duplication) 
which do not contain a weighting factor not equal to 1. The second value shows that 
besides firing any number of transitions which do not contain a weighting factor of 
a key transition, t qi is also fired, and then any number of transitions of a weighting 
factor equal to 1 can be fired. We continue this enumeration and find all values 
in the above sequence are feasible. The order of the transitions in the sequence 
obviously holds the correct precedence relationships, i.e., we should fire t qi first, and 
then fire t q2 , and so on, and at last fire t qs . Moreover, the sequences contain all 
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possible copies of key transitions and are therefore complete. 

Q.E.D. □ 

The corollaries listed below directly follow from Theorem 6.2. 

Corollary 6.1 For a fuzzy Petri net marked using the prime number marking algo- 
rithm, m t (Q t ) = {1, 10 _r , 10 _T xPj, 10 _t xPixP 2 , • ••, 10 -T x P x x P 2 x . . . x P,}. 

Corollary 6.2 The search in the fuzzy Petri net is halted at a token value a' ^ 
m t{Qt), but will not exclude any feasible, complete sequence which has correct 
precedence relationships among operations. 

Corollary 6.2 is used to search all possible correct sequences which satisfy the 
three properties from the fuzzy Petri net off-line. When a set of enabled transitions 
are found for the development of partial sequences, those transitions which lead to 
undesirable token values in the corresponding output places are discarded. 

6.4.4 Multiple Assigned Key Transition Sequences 

In the previous sections, it was assumed that the order of the key transitions 
is assigned in advance and only one order is feasible. However, in practice, it may 
often occur that more than one partial ordering of key transitions are possible. For 
example, suppose t a and t), are key transitions, both sequences . . . t a . . . t\, . . . and 
. . . tb . . . t a . . . may be feasible. The plan representation should include feasible and 
complete sequences which satisfy either ordering of key transitions. 

The problem of multiple partial orderings may be solved in a straightforward 
manner by enumerating all possible orderings of process steps and constructing the 
union of the plans from each set. 

In general, if we have k feasible assigned key transition sequences, Si, 52, ... , S*. 
For each 5,, we use the planning strategy described above and obtain all feasible, 
complete, and correctly ordered sequences represented as {p/an(5,)} which is a set of 
sequences. Then the final complete sequence set can be obtained a s Ui=i{p^ an (‘?«)}- 
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6.5 Fuzzy Representation for Multiple Soft Components 

Often several soft components may be present in a complex system. For ex- 
ample, more than one type of part might need to be processed in a given system, 
and then be assembled. The properties for all these soft components may change. 
In this case, a more general marking and sequencing algorithm is required to permit 
correct reasoning when multiple soft components take part in a transition. This 
section describes an algorithm which provides a consistent strategy and reduces to 
the previous reasoning mechanism when a single soft component is present. 


6.5.1 Fuzzy Reasoning for Multiple Soft Components 

We assume we have r soft components labeled as C \ , C 2 , . . . , C T , respectively. 
For any soft object 0: 

{ 1 if 0 is the j type soft object, 

1 <3<r. 

0 otherwise, 


An assembly or subassembly may contain both Cj and other soft components: 


softij... k (0 ) 


1 if 0 is the i-j-. . .-k type soft object, 

< 1 < t. 

0 otherwise, 


The i-j-. . .-k type soft object is defined as an assembly or subassembly containing 
all the soft components labeled as Ci, C : . . ., and Ct, and no other soft components. 

Based on these definitions, a strategy which uses a prime number sequence 
to represent key transitions with multiple soft components was presented in [12]. 
In that approach, P u P r+1 , P 2r+ i, . . ., P^-ijr+i was used to represent the 1st 
subsequence of prime numbers for marking the key transitions corresponding to 
the 1st soft component. P 2 , P r+2 , P 2r + 2 , ..., P(„-i)r+2 was used to represent the 
2nd subsequence of prime numbers marking those corresponding to the 2nd soft 
component. Continuing this procedure, P r , P 2r , P3 r , . . ., P( 3r -i) r +r(=* r r) was used 
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to represent the rth subsequence of prime numbers for the rth soft component. In 
this chapter, we will use a related, but simpler, approach which assigns the same 
sequence of prime numbers for the key transitions corresponding to different kinds 
of labeled, or ‘colored’, soft components. VVe can generalize the representations in 
(6.4), (6.5) and (6.6) to obtain the corresponding fuzzy reasoning rules for output 
places for three types of transitions, as follows: 

Assembly operation: 0,, , 0, 2 , . . . , 0, u — ► Oj. The objects O,, , 0, 2 , . . . , 0i u , Oj 
may contain more than one soft component. Therefore, the representation for those 
kinds of soft objects should be distinguished from other objects and at any given 
time, we should be able to reason about the characteristics of these objects. Before 
we give the function for the assembly operation, we first give the definition of min 
and trs for each object. We also assume t v will function on the jth soft component. 

if softj(Oi t ) = 1, then min(0i s ) = crj and trs(0i,) = (j, oy x WF V ), 

if softi h „k{Oi,) = 1, then mm(0,,) = min(cri, <Tj , . . . , <7k) and 
trs(0i,) = (2>,)(J0>j x 

otherwise , min(0i t ) — 1 and trs(0i,) = 0) 

1 < s < u. 

The generalization of formula (6.4) is: 

if min(min(0if),min(0if), . . . ,min(0i u )) > $, then 

U 

a 1 = soft(Oj) x (J trs(0i,) + 1 - soft(Oj), 

1 

where 

Soft(Oj) = Soft,(0j) + 2>o/t t *(0 ; ) + ■ • • + JZ 5 °/ f X2...r(0j). (6.11) 

i ik 12.. .r 
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Disassembly operation: 0, — ► 0 n , O n , . . . , 0j r The generalization of formula 
(6.5) is: 

if min(Oi) > #, then a 3 = soft(O s ) x trs(0 3 ) + 1 — soft(0 3 ), 

ji < s < ji . (b-12) 

1ST operation: 0 P —■ > 0 q . 

if min(Op) > 0, then cr q = soft(O q ) x frs(0,) + 1 — soft(O q ). (6.13) 

6.5.2 Generalized Prime Number Marking Algorithm 

For a system with more than one soft component, we should know the status 
of the current objects at each step of the process, i.e., which soft components the 
objects contain, and the degree of completion for this soft object as well as every soft 
component it contains. For the sake of simplicity, we assume all soft components in 
the system are independent of each other, i.e., there are no relations between the 
orders of key transitions for any two soft components. Moreover, we still want to 
guarantee the precedence relationships among operations for each soft component, 
so that the combinations of several soft components will still hold this property. 
The prime number marking algorithm is generalized as follows: 

Generalized Prime Number Marking Algorithm 

Input: the ordinary Petri net mapped from an AND/OR net, the prime number 
table, soft components C u C 2 , . . C r , the numbers of steps for changing properties 
for each soft component S\, S?, . . ., S r . 

Output: a fuzzy Petri net. 

step 1: Initialization. For all transitions *,(1 < j < m), the weighting factor of t 3 , 
WFj = 1 . 
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step 2: For all 1ST transitions, pick those transitions which make the changes 
of properties for Ci, 1 < i < r, and order them according to the required 
sequence of changes. Suppose these transitions are t\ , <21 • • • , t's ■ 

step 3: For 1 < i < r, set WF{ = P x , WF{ = P 2 , . . . , WF}. — Ps,. 

step 4 •' Map the initial marking from the original Petri net. For each place pj, 

1 < j < n, set the corresponding token value a' to have the same token value 
as in the ordinary Petri net. 

step 5: For each C,, 1 < i < r, select a positive integer Ti, such that 

0.1 < 10' T> x WF[ x WFi x ... x WF' St < 1.0. (6.14) 

step 6: Mark cr J the value of (i, 10 -r ‘ ), if Oj contains only (?,; Mark cr J the value of 

(* 1 , 10 _Ti * ) U(* 2 ) 10 _T, 2) U • • • (*«, 10 -T ' u ), if Oj contains soft components Ci t , 
C h , ..., C iu , 1 <u <r. 

An example of this case is obtained by adding to Figure 6.1 a visual sensor 
mounted near the gripper of the robot arm. Before the peg is inserted into the 
hollow cylinder, the robot should move near the cylinder to sense the exact insertion 
position. The sensing operation refines the internal state(size and position) of the 
cylinder, and for this example the cylinder C becomes a soft object. This sensing 
operation can be done anytime the robot is not holding anything. We model the 
combination of the two interacting components R and Casa subassembly marked 
RC. The sensing process is represented as SEN. The corresponding updated 
AND/OR net and the ordinary Petri net is shown in Figure 6.9 and Figure 6.10, 
respectively. 

For this example, the resulting updated fuzzy Petri net is shown in Figure 
6.11. There are two soft components, peg P and hollow cylinder C in the system. 
The parameters are r = 2, S\ = 2 and 52 = 1. ts and t$ are key transitions for P 
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Figure 6.9: The updated AND/OR net. 


and *17 is the key transition for C. Therefore, WF$ = Pi = 2, WF 9 = P2 = 3, and 
WFn = Pi = 2. Because 10 _1 x WF S x WF 9 = 0.6 and 10 -1 x WF l7 = 0.2 satisfy 
(6.14), er 2 = (1,0.1) and cr 3 = (2,0.1). The token value for place PC in the final 
marking is (1, 0.6) U(2, 0.2). 

6.5.3 Interpretation of Fuzzy Values for Multiple Soft Components 

We may interpret the case of multiple soft components in analogy to ‘colored’ 
Petri net models[54]. In this context, we say different soft components have different 
colors. A soft object may contain different kinds of soft components, and we call this 
object a composite object. However, we assume that the colors of soft components 
in one object will not be mixed up, i.e., the colors are independent. Knowing the 
number of soft components in the system as well as the sequence of key operations for 
each soft component, we can map the the weighting factors of these key transitions 
sequences of prime numbers depending on the color of the soft object. Therefore, 
at any given time, we can get a unique decomposition of primes corresponding to 
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Figure 6.10: The updated ordinary Petri net. The names of soft objects are followed 
by a symbol: 
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Figure 6.11: The fuzzy Petri net mapped from the updated ordinary Petri net. 
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one soft component such that a correct precedence relationship can be verified to 
be followed. 

As in the case of a single soft component, we can map the prime token values to 
fuzzy values uniformly distributed in [0, 1] for each different color of the object. For 
a soft object which contains more than one soft component, the degree of completion 
of this soft object can be understood by looking at the degrees of completion of the 
soft components independently. For the object PC shown in Figure 6.11, if the 
cutting job has been done on P, and neither sensing on C nor lubricating on P 
starts, the interpreted fuzzy value of P is 0.5 and the value of C is 0, as discussed in 
the last section. After we finish sensing on C and lubricating P still doesn’t start, 
the value of P is 0.5 and the value of C is 1. After all jobs are finished on soft 
components P and C, the value of P and C are both 1. 

Because the prime number representation and the marking for different colors 
keep token values of soft components inside a soft object independent, it is conve- 
nient to reason about the degree of completion for any soft component in an object. 
If we map the prime token values for multiple soft component case to fuzzy val- 
ues, we are also able to obtain straightforward modification for weighting factors 
of transitions to keep fuzzy reasoning strategy valid for reasoning fuzzy values, as 
indicated in the last section. This is a principal advantage to using prime number 
marking for the multiple soft component case. 

6.6 Simulation Results and Conclusions 

For the example shown in Figures 6.1, 6.2 and 6.3, using the ordinary Petri net 
directly mapped from the original AND/OR net, we obtain 13 feasible sequences to 
accomplish the cylinder assembly task. However, when we search the fuzzy Petri 
net mapped from this ordinary Petri net(see Figure 6.8), we obtain only one se- 
quence which is feasible, complete and maintains correct precedence relationships 
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for operations, i.e., tl t3 t5 t6 t4 t8 t9 tlO t7 1 12 tl3. 

For the example with added sensing shown in Figure 6.9, when we search all 
feasible sequences, we get the following 39 sequences: 

*** Sequence 1 ***tl5 tl7 tl8 tl6 tl tl2 tl3 
*** Sequence 2 ***tl5 tl7 tl8 tl6 tl t8 t9 tlO t7 tl2 tl3 
*** Sequence 3 ***tl5 tl7 tl8 tl6 tl t8 t9 tlO t7 t3 t5 t6 t4 tl2 tl3 

*** Sequence 4 ***tl5 tl7 tl8 tl6 tl t8 t9 tlO t7 t3 t4 tl2 tl3 

*** Sequence 5 ***tl5 tl7 tl8 tl6 tl t8 t7 tl2 tl3 

*** Sequence 6 ***tl5 tl7 tl8 tl6 tl t8 t7 t3 t5 t6 t4 tl2 tl3 
*** Sequence 7 ***tl5 tl7 tl8 tl6 tl t8 t7 t3 t4 tl2 tl3 

*** Sequence 8 ***tl5 tl7 tl8 tl6 tl t3 t5 t6 t4 tl2 tl3 

*** Sequence 9 ***tl5 tl7 tl8 tl6 tl t3 t5 t6 t4 t8 t9 tlO t7 tl2 tl3 
*** Sequence 10 ***tl5 tl7 tl8 tl6 tl t3 t5 t6 t4 t8 t7 tl2 tl3 
*** Sequence 11 ***tl5 tl7 tl8 tl6 tl t3 t4 tl2 tl3 
*** Sequence 12 ***tl5 tl7 tl8 tl6 tl t3 t4 t8 t9 tlO t7 tl2 tl3 

*** Sequence 13 ***tl5 tl7 tl8 tl6 tl t3 t4 t8 t7 tl2 tl3 

*** Sequence 14 ***tl5 tl6 tl tl2 tl3 
*** Sequence 15 ***tl5 tl6 tl t8 t9 tlO t7 tl2 tl3 

*** Sequence 16 ***tl5 tl6 tl t8 t9 tlO t7 t3 t5 t6 t4 tl2 tl3 

. *** Sequence 17 ***tl5 tl6 tl t8 t9 tlO t7 t3 t4 tl2 tl3 

*** Sequence 18 ***tl5 tl6 tl t8 t7 tl2 tl3 

*** Sequence 19 ***tl5 tl6 tl t8 t7 t3 t5 t6 t4 tl2 tl3 

*** Sequence 20 ***tl5 tl6 tl t8 t7 t3 t4 tl2 tl3 

*** Sequence 21 ***tl5 tl6 tl t3 t5 t6 t4 tl2 tl3 

*** Sequence 22 ***tl5 tl6 tl t3 t5 t6 t4 t8 t9 tlO t7 tl2 tl3 

*** Sequence 23 ***tl5 tl6 tl t3 t5 t6 t4 t8 t7 tl2 tl3 

*** Sequence 24 ***tl5 tl6 tl t3 t4 tl2 tl3 
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*** Sequence 25 ***tl5 tl6 tl t3 t4 t8 t9 tlO t7 tl2 tl3 

*** Sequence 26 ***tl5 tl6 tl t3 t4 t8 t7 tl2 tl3 

*** Sequence 27 ***tl tl2 tl3 

*** Sequence 28 ***tl t8 t9 tlO t7 tl2 tl3 

*** Sequence 29 ***tl t8 t9 tlO t7 t3 t5 t6 t4 1 1 2 1 1 3 

*** Sequence 30 ***tl t8 t9 tlO t7 t3 t4 tl2 tl3 

*** Sequence 31 ***tl t8 t7 tl2 tl3 

*** Sequence 32 ***tl t8 t7 t3 t5 t6 t4 1 12 1 13 

*** Sequence 33 ***tl t8 t7 t3 t4 tl2 tl3 

*** Sequence 34 ***tl t3 t5 t6 t4 1 1 2 1 13 

*** Sequence 35 ***tl t3 t5 t6 t4 t8 t9 tlO t7 tl2 tl3 

*** Sequence 36 ***tl t3 t5 t6 t4 t8 t7 tl2 tl3 

*** Sequence 37 ***tl t3 t4 tl2 tl3 

*** Sequence 38 ***tl t3 t4 t8 t9 tlO t7 1 12 tl3 

*** Sequence 39 ***tl t3 t4 t8 t7 tl2 tl3 

When we map this updated ordinary Petri net to a fuzzy Petri net(see Figure 
6.11) with two soft components, only one sequence is obtained. This is equal to 
Sequence 9 in the above sequence set. Therefore, we can conclude that even though 
the searching effort for transition sequences as well as the number of sequences 
obtained for an ordinary Petri net will increase exponentially relative to the in- 
creased number of transitions and places, the number of sequences searched in the 
corresponding prime number marked fuzzy Petri net may be strongly restricted by 
ordering constraints on the process steps. The fuzzy Petri net thus appears to be an 
efficient tool for modeling and representing all feasible, complete process sequences 
which maintain the correct precedence relationships. 

One of the fuzzy Petri net variable types, the global fuzzy variable, is used 
in this research to efficiently search for correct operations sequences from a fuzzy 
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Petri net to reach from an initial state to a final state while satisfying precedence 
and completeness constraints. When the planned sequence is developing, the global 
values carried by tokens are subject to change. If more than one soft component 
is handled, a generalized assignment algorithm can be used so that a colored se- 
quence of prime markings will be used for each different soft component. The prime 
token values used for searching can also be interpreted as a fuzzy value uniformly 
distributed between 0 and 1. When we search the sequences in the fuzzy Petri net, 
all sequences which will be incomplete or having incorrect precedence relationships 

will be discarded. Computation time and storage is reduced since it is not necessary 

« 

to store those incorrect sequences. 



CHAPTER 7 

SENSOR-BASED ERROR RECOVERY FOR ROBOTIC TASK 
SEQUENCES USING FUZZY PETRI NETS 


During the execution of a task based on an off-line planned sequence of operations, a 
robot workcell may encounter errors or events which cause the expected sequence to 
be unexecutable. This chapter addresses the problem of representing and automati- 
cally invoking error recovery sequences in response to sensed errors during execution. 
The approach is based on the use of a fuzzy Petri net model in which sensory verifi- 
cation operations determine local fuzzy variables associated with the objects in the 
net. The outcome of a sensory verification operation may change the local fuzzy 
variables and leads to an altered firing sequence and resulting error recovery. The 
fuzzy Petri net itself is systematically derived from an AND/OR net model of the 
task[10, 11], and carries guaranteed properties of safeness, liveness, and reversibility, 
while the fuzzy assignment algorithm for global fuzzy variables[12, 20] guarantees 
precedence of subgoal operations. An algorithm is described for adding sensory 
verification transitions and associated fuzzy transition rules which implement error 
recovery through retry or alternative sequence mechanisms. An executable fuzzy 
Petri net could be obtained using a feasible, complete, and correctly ordered se- 
quence. 

7.1 Introduction 

In previous work, we have used AND/OR graphs[47] and nets[10, 11] to repre- 
sent geometric relations and operations in robotic assembly workcells and materials 
handling systems. Based on the characteristics of components and relations which 
may change their properties during the execution of plans, we introduced the con- 
cept of a fuzzy Petri net representation and a method of reasoning about correct 
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precedence relationships among task subgoals[12, 20]. In the fuzzy Petri net, a 
j prime number marking algorithm guarantees strong numerical constraints on the 
precedence and reduces the set of feasible sequences. Using fuzzy Petri nets, we can 
search and obtain all possible sequences which guarantee the properties of feasibil- 
ity, completeness, and correct precedence relationships for subgoal operations. The 
resultant sequence set from the fuzzy Petri net requires less computer storage and 
time to search for good solutions compared with the strategy used in (10, 11]. The 
token values for all places in the fuzzy Petri net can be interpreted as fuzzy values 
in [0, 1] which represent the degree of completion for each object in the system. The 
fuzzy values representing internal state variables which are defined as local fuzzy 
variables are used in this chapter to derive a sensor-based verification and reasoning 
strategy for exception handling. 

Task sequence planning is normally performed off-line using a high-level rep- 
resentation of goals and constraints. Task sequences generated based on a system 
model and an initial and final state are expected ordered operations sequences, i.e., 
with the assumption that no abnormal events will happen. However, at execution 
time some unexpected conditions may occur; for example, some components may 
be missing, some objects may be put at incorrect positions, or, the orientations of 
some components may not be the same as stored in the computer. Therefore, prac- 
tical automated manufacturing systems often incorporate an enormous amount of 
control code for error handling and recovery [41]. Some approaches to error recovery 
for assembly workcells have been reviewed in Section 2.4. 

In this chapter, we address the problem of automatically invoking error re- 
covery sequences within a set of possible execution sequences described by a fuzzy 
Petri net. The fuzzy Petri net incorporates many possible feasible sequences, and 
the resultant firing sequence depends on the fuzzy values in the net. A sensory ver- 
ification operation is used to observe the system state, and the outcome of sensory 
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verification may change the local fuzzy variables associated with the objects leading 
to an altered firing sequence. If the fuzzy Petri net is correctly designed, this altered 
firing sequence will eventually lead to a goal state by correctly executing an error re- 
covery procedure. A main goal of this chapter is to introduce a systematic approach 
to synthesis of this fuzzy Petri net with sensor verification and error recovery. 

7.2 Fuzzy Petri Net Representation of Task Level Operations 

The definition for the generalized fuzzy Petri net[12, 14, 17, 18] is shown in 
Section 5.2. In this definition, p may be regarded as a fuzzy internal state variable. 
In practice, these variables may also be used as conventional internal state variables. 

Each place in the FPN represents an object. Therefore, the local fuzzy vari- 
ables and fuzzy marking variables are associated with the objects. In the discussions 
in this chapter, we only use global fuzzy variables and local fuzzy variables for the 
representation of sequence planning and error recovery, respectively, /, has a rule for 
reasoning about local fuzzy variables, r p (^)(written as r*'), and a rule for reasoning 
about global fuzzy variables, tv(£,)( writ ten as r' 1 ). The fuzzy marking variable is 
also useful in error recovery, since it models the uncertain outcomes of operations, 
but this will not be discussed in this chapter. 

Because there are three different kinds of variables associated with places and 
tokens in the FPN, three different system states may be defined[17, 22]. Two of 
them, local fuzzy state and global fuzzy state, are used in this chapter and their 
definitions were given in Section 5.3. Here, p(pi) is written as p, and cr(p, ) is written 
as <r,. A local fuzzy variable represents the internal state of an object. 

In this chapter, the fuzzy Petri net representation is used as follows. Each 
place, p^ represents a system geometric substate, or subassembly, and O, corre- 
sponds to a node in the AND/OR net. For example, the state “robot holding an 
object” might be a place, p,. Each transition, t{j, represents a state change signified 


1 



167 


by the transfer of tokens from input place set U.{p«'} to output place set U 
The operation “robot places the object on the table” might be a transition, a and $ 
are the mappings which define feasible transitions among system states for a given 
workcell. 

Each token in the fuzzy Petri net may take on some fuzzy membership value, 
m t (qj ) = U or, e, which constitutes a global fuzzy state of the net, S g . In 
our definition of the net, the global fuzzy variable constitutes a ‘degree of completion’ 
of a process. Each transition has a weighting factor W Fi which affects the fuzzy 
value of the token when the transition is fired. The changing of local fuzzy variables 
follow specific reasoning rules[17, 18]. The rules governing the mapping of fuzzy 
values of tokens across transitions will be described in the next section. 

In [12], we showed that a set of fuzzy values of tokens and transition weights 
could be developed which guarantee that a set of designated operations, called key 
transitions, would be executed in a designated precedence order. The prime number 
marking algorithm[12, 20] used to synthesize this net imposes numerical constraints 
on the fuzzy values of tokens in order to enforce these precedence relations. In this 
approach, the key transitions may be viewed as subgoals in the task which yield key 
states and have fixed prior order constraints. Enforcing these constraints implicitly 
in the net representation leads to efficient search for feasible solutions. 

Figure 7.1 shows an example of a robot workcell which is a modified version of 
Figure 6.1. In this task, the robot picks up the raw peg, transfers it to the cutting 
machine, then to the lubricating machine to process the peg, and finally to the 
hollow cylinder to accomplish the assembly. The sensor on the head of the robot 
arm is used to identify the precise position of the hole inside the hollow cylinder. 

In modeling real processes, we do not need to represent all tokens with fuzzy 
values, since not all objects updergo changes in properties or relations during the 
process. For convenience, we will define a class of objects which do undergo these 
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Figure 7.1: A peg-cylinder assembly system. 
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changes as soft objects: 

Definition 7.1 Soft components and soft objects: A soft component is a single part 
in a system whose “properties” change during execution of plans. For purposes here, 
these are mostly often geometric properties, such as the change in shape of the peg 
in example 1. 

A soft object may be either a soft component, or an assembly or subassembly which 
includes a soft component, or an object with soft relation between parts. 

Soft components and objects are characterized by soft parameters , which are 
internal state variables such as geometric parameters of shape or relative positions 
of parts in an assembly, but may also include mechanical properties such as surface 
characteristics. In this chapter, some of these soft parameters will be modeled by 
local fuzzy variables. 

In example 1, one soft parameter of the peg is the diameter, which is changed 
by the cutting operation, and the second is surface lubrication state which is changed 
by the lubrication operation. A soft parameter of the object RPC is the geometric 
relation of the peg axis to the cylinder axis which will determine whether insertion is 
feasible. In Section 7.4, the sensory verification operation will be used to observe the 
current values of soft parameters during execution, map them to fuzzy membership 
functions, and control the resulting flow of the sequence using fuzzy reasoning at 
the transitions. 

The corresponding fuzzy Petri net for the peg-cylinder assembly example is il- 
lustrated in Figure 6.11. The weighting factors assigned to transitions, and the initial 
global fuzzy state are shown. The fuzzy firing rules for token values are described in 
Section 7.3. The threshold 6 is 0.05. Ail feasible objects in the system are mapped to 
places in the net: pirR(robot), p 2 *P(p e g)i ps:M(cutting machine), p 4 :L(lubricating 
machine), p 3 :C(hollow cylinder), p 6 : RP(robot grasping peg), p 10 :RPM(robot trans- 
ferring peg to cutting machine), pi 2 :CUT(cutting job), p 9 ;RPL(robot transferring 



170 


K =* 

i : 


peg to lubricating machine), p n :LUB(lubricating job), pi 3 :RC(robot grasping hollow 
cylinder), pi 4 :SEN(sensing job), p 8 :RPC(robot inserting peg into hollow cylinder) 
and p 7 :PC(peg and cylinder assembly). The global fuzzy state of this fuzzy Petri 
net is constructed based on a required precedence of subgoal operations: cutting(f 5 ) 
precedes lubrication^) precedes insertion(tj2), and position sensing(fir) precedes 
insertion(fi2). fs, £9 and tn are key transitions in the system, and are defined a 
priori. Based on the prime number marking a!gorithm[ 12 , 20 ], the mapping from 
transitions to integer values is WFn = 2 , WF$ = 2 , and WFg = 3 , and all other 
weighting factors are equal to 1 . From the same algorithm, the initial global fuzzy 
state of (pi, p 2 , ..., Pu) T is found to be ( 1 . 0 , ( 1 , 0 . 1 ), ( 2 , 0 . 1 ), 1 . 0 , 1 . 0 , e, e, e, e, e, 
e, e, e, e) T . We have shown in [ 12 ] that only one shortest sequence, which is fea- 
sible, complete, and maintains correct precedence relationships, is obtained, i.e., 
^15^17^18^16^1 ^3 ^5 ^6^4 ^8^9^ 10^7^12^13* To find this sequence, we have assumed that each 
transition can be fired at most once. In this sequence, the robot goes to the hollow 
cylinder to sense the position of the hole before it carries the peg for machining. 

For the purposes of planning this sequence, the sensing operation is assumed 
to be deterministic and always successful. In Section 7 . 4 , we introduce a nonde- 
terministic fuzzy Petri net in which the outcome of the sensory measurement may 
affect the sequence at execution time. 

7.3 Fuzzy Transition Rules: Global Fuzzy Variables 

During the execution of a task sequence, the system reasons about fuzzy values 
of tokens and the local fuzzy variables of the objects after a transition a fired. In 
this section, we assume the local fuzzy variables are not affected by transitions, and 
focus on transition reasoning rules affecting global variables. In the next section, we 
will discuss the role of local fuzzy variables in transition reasoning rules. A set of 
fuzzy transition rules for global fuzzy variables in the case of one soft component is 
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(a) Before t k is fired. (b) After t k is fired. 

Figure 7.2: Fuzzy Petri net representation for assembly operation. The local fuzzy 
variables for 0 tl , 0, 2 , and 0 } are p M , p, 2 , and respectively. The values of tokens 
in the places of 0 n and 0, 2 are <t' ! and cr' 3 in (a) and that in the place of 0j is a 3 
in (b), respectively. The weighting factor of tk is WFk- 

given as below. If a system contains more than one soft component, a generalized 
version of fuzzy transition rules can be used[12, 20], The symbol 9 in the following 
discussion refers to the threshold of reasoning rules. 

Assembly operation: 0 M , 0, 2 , ..., 0 ivL -+ 0 } . The fuzzy Petri net corre- 
sponding to the assembly operation with two input places is shown in Figure 7.2, 
and obeys the following fuzzy transition rule: 

if mm(cr' 1 ,cr' 2 , . . . ,a ,u ) > 9 , then a 3 = mincer' 1 , <j ' 3 cr 1 ' 1 ) x WF k . (7.1) 

Since WFk > 1, this rule assigns the same or increased completion value to 
the output token as that held by the minimum input token. 

Disassembly operation: 0, -*■ 0 ;i , 0 J2 , ..., 0j r The fuzzy Petri net 
corresponding to the disassembly operation with two output places is shown in 
Figure 7.3, and obeys the following fuzzy transition rule: 

if a' > 9 , then <r 3d = c' x WFk x $oft(Oj d ) + 1 — soft(Oj d ), 


(7.2) 
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(a) Before t k is fired. 


(b) After t fc is fired. 


Figure 7.3: Fuzzy Petri net representation for disassembly operation. The local 
fuzzy variables for 0,, Oj 1} and Oj 2 are />,, p n , and pj 2 , respectively. The values of 
tokens in the places of 0 n and 0 J3 are <t Ji and <r j2 in (b) and that in the place of 
Oi is cr' in (a), respectively. The weighting factor of tk is WFk- 



Figure 7.4: Fuzzy Petri net representation for 1ST operation. The local fuzzy 

variables for 0 V and 0 q are p p and p q , respectively. The values of tokens in the 
places of 0 P and 0 q are a p and cr q in (a) and (b), respectively. The weighting factor 
of tk is WFk. 


softiOj*) = { 


1 < d < l. 


where 

/ 

1 if 0 Jd is a soft object, 

0 otherwise, 

Since WFk~> 1, this rule assigns the same or increased completion token value 
to each soft object and leaves other objects at 1. 

Internal State Transition(IST) operation: 0 P — ► 0 q . The fuzzy Petri net 
corresponding to the 1ST operation is shown in Figure 7.4, and obeys the following 
fuzzy transition rule: 


if a p > 9, then a q = a p x WFk- 


(7.3) 
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Since nj k > 1, this rule assigns the same or increased completion value to the 
output token. 

7.4 Execution of Plans on the Fuzzy Petri Net 

During the real-time execution of a selected sequence which is feasible, com- 
plete, and maintains correct precedence relationships for key transitions, some of 
these key transitions may not cause the expected results. This uncertainty in local 
parameters can be represented by local fuzzy variables associated with objects. For 
example, we assume the input place of a key transition t, , namely py , contains a 
token with fuzzy value tP before t, is fired. The weighting factor for t{ is WFi. As 
mentioned in the previous discussions, the prime token value in the output place 
p' is a’’ = ( 7 J x WFi , assuming p(pj-) is fixed. In the real-time execution of the 
planned sequence, it may happen that p{py) is changed because errors may occur 
during the execution of while the global token value of tr 7 does show that f, has 
been successfully executed. 

To guarantee a correct fuzzy token moving in the Petri net, we introduce a 
sensor which verifies the states for soft objects, especially after key transitions are 
fired in the system. In order to incorporate such sensor-based selection of operations, 
we need to define fuzzy rules governing an additional type of Petri net module cor- 
responding to mutually exclusive operations for the execution of plans on-line. This 
module reasons about the local fuzzy variables based on the input local variables. 
Therefore, during the execution of a task sequence, the selection of enabled tran- 
sitions not only depends on token values(global fuzzy variables), but also on local 
fuzzy variables. In a fuzzy Petri net model used for planning, the alternative choice 
of mutually exclusive operations is resolved by the off-line search for an expected 
plan. However, real-time execution of the net requires local resolution of this choice 
and will depend on the current local variables which occur. The fuzzy transition 
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Figure 7.5: Fuzzy Petri net representation for ME transitions. In (a), The global 
fuzzy variables and local fuzzy variables of O e are a t and p e . In (b), the global fuzzy 
variable of 0 97 is a g7 . The weighting factors of t kl ,t, t 2 , . . t kv are W F kt , W F k7 , . . ., 
WF kv , respectively. 

rules for this important case are given below. 


7.4.1 Mutually Exclusive Transitions 

The fuzzy Petri net corresponding to the mutually exclusive operation: (0 e — + 
0 gi OR O e —* O g7 OR . . . OR O e — ► 0 9v ), is shown in Figure 7.5. Here, sensors are 
introduced to verify the states for soft objects. Therefore, the following operations 
may be chosen based on fuzzy sensory information. For the sake of simplicity, we 
assume the local fuzzy variables appearing in the following discussions are fuzzy 
singletons. The results obtained can be generalized to the case of general fuzzy 
numbers. The transitions which represent this type of operation are called mutually 
exclusive, or, ME, transitions. 

The fuzzy rule governing this mutually exclusive firing strategy is described 
as follows: 

*/ 0 < p e < 9 l , then a 31 = WF kl x <r e , a 92 = a 93 = ... = a 9 " = 0; 

. . . = a 9 ” = 0; 


if 9 l < p e < 9 2 , then a 92 = WF k7 x <r e , cr 31 = a 93 = 
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if O' 1 < p e < O', then a 9 ' = WF kl x cr e , a 9i = 


= a 3 '* 1 = a 9,+1 = 


= . . . = < 7 S ” = 0 ; 


if e v ~ l <p e < 6 V , then a 9 ' = WF kv x < 7 e , a 31 = a 9 * = ... = a 9 - 1 = 0. (7.4) 

Notice that the range [O,0 V ] has been divided to v subranges, [0,0*), [0\0 2 ), • . 
[0 V_1 , Q v ], which are mutually exclusive. Only one transition from t 3l , t gi , . . t 3v will 
be fired. The selection of the transition is based on the real-time value of p e . The 
ME transition acts like a “case” conditional statement in a high-level programming 
language. 

7.4.2 Deterministic and Nondeterministic Fuzzy Petri Nets 

In this discussion, we have assumed that each transition t{ in the net has 
a constant weighting factor WFi , i.e., the fuzzy values of tokens in output places 
for t{ can be directly determined from the fuzzy values of tokens in corresponding 
input places. This assumption is valid from the planning point of view where we can 
guarantee a selected feasible sequence to reach from the initial state to the final state 
when this sequence is executed. However, this assumption is not always correct from 
the execution point of view. Some transitions, especially key transitions, may not 
reach the desired result as expected after the corresponding operation is executed in 
practice. Therefore, we distinguish deterministic and nondeterministic fuzzy Petri 
nets to reflect the possible random properties of the transitions at execution time. 

Definition 7.2 Deterministic fuzzy Petri net(DFPN): A fuzzy Petri net(FPN) in 
which each transition t{ has a deterministic reasoning rule for local fuzzy variables, 
r 1 ' and therefore a fixed mapping between input and output local fuzzy variables. 

Definition 7.3 Nondeterministic fuzzy Petri net(NDFPN): A fuzzy Petri net(FPN) 
in which there exists at least one transition t k which has a random reasoning rule 
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for local fuzzy variables. There is no fixed mapping between input and output local 
fuzzy variables. The expected mapping of local fuzzy variables are known corre- 
sponding to the mapping of input and output token values. 

Definition 7.4 Random transition: A transition which has a random mapping be- 
tween input local fuzzy variables and output local fuzzy variables. 

A DFPN contains no random transition. An NDFPN contains at least one 
random transition. The fuzzy Petri net generated from the AND/OR net is an 
example of a DFPN; however, during the execution of a planned sequence, some 
transitions might have random properties. For example, in Figure 7.1, if we assume 
t 5 cannot always guarantee the cutting to the correct size, then t s becomes a random 
transition. This modified fuzzy Petri net is an example of an NDFPN. 

7.4.3 Planning and Execution on the NDFPN with ME Transitions 

If we model some key transitions in the DFPN as random transitions, the pre- 
vious planning strategy may not be suitable for searching sequences in an off-line 
planning mode because the net has become an NDFPN. To approach this problem, 
we assume that the reasoning function for local fuzzy variables of all random tran- 
sitions are their expected reasoning functions , and the resulting NDFPN will thus 
become a DFPN. We can use the planning procedure on the DFPN as before to get 
the expected correct sequences. 

For the sake of simplicity, we first consider the case that ?■ is the only random 
transition in the net, and retry of the operation t* is chosen as the error recovery 
strategy. After f- is executed, a sensing transition defines a new local fuzzy variable 
Pj which determines the next firing through an ME transition. We assume an 
expected sequence searched from a DFPN, of which all key transitions are assigned 
the weighting factors for reasoning token values, is • • • t*S r +i, where S\, 
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S 2 , S r +i are subsequences which do not contain any key transitions, and t\, 

< 2 , tr are r key transitions. We assume that after we execute V- during the 

implementation of this task sequence, we may meet three possible cases:(Figure 7.6) 

(1) Succeed : Based on the sensory verification operation, a ‘correct’ local fuzzy 
variable is obtained after t" is fired. We then go on executing the remaining part 
of the sequence. The final actual sequence may be exactly the same as the planned 
sequence. 

(2) Retry and Succeed i Based on the sensory verification operation, we do not 
obtain a correct local fuzzy variable following t". The refiring of t\ is required. 
This transition may be fired totally /(I < / < M\ M is a repair threshold) times. 
The actual sequence which is executed may be(we consider sense and as virtual 
transitions for the sequence representation.) 

(The specific mechanism for enabling this retry process using fuzzy values is dis- 
cussed below.) 

(3) Retry and Fail: After firing of t 1 - /'( 1 <1'<M ) times, an unrecoverable 
condition is detected for a soft object leading to global error recovery(firing of S gr ) 
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or halt. For example, a certain soft object or the included soft component, may 
need to be discarded and replaced by a new soft object. At this time, we assume 
the execution of the remaining part of the sequence is stopped. The actual sequence 
which is executed for this case will be 

The selection of M is sometimes an important factor to implement a sequence. 
And the selection may depend on different criteria for different key transitions. If 
M is chosen too large, a transition loop has to be executed many times so that 
the threshold is reached and the sequence can stop. If M is chosen too small, the 
possibility for local error recovery for some key transitions will be lower. Moreover, 
sometimes the error is due to the hardware mechanisms such as machines, processing 
units, and so on. We may have several alternative transitions available for an identi- 
cal logical transition. In the previous example, we may have two cutting machines. 
Any planned sequence may choose one of these two machines when a cutting tran- 
sition is fired. When a cutting machine causes an erroneous state on the processed 
part, we may need to try another cutting machine for local error recovery, rather 
than continuing using the former one. In other cases, a more extensive alternative 
sequence may be employed, or a more general global error recovery sequence may 
be initiated. 

Figure 7.7 shows the global and local alternative error recovery for the peg- 
cylinder assembly example. Figure 7.7(a) illustrates a feasible sequence to finish the 
assigned assembly task. Figure 7.7(b) depicts that a global alternative error recovery 
sequence may be called when a threshold of times for retry could not remedy the 
insertion error. Figure 7.7(c) shows that local alternative error recovery may be 
necessary when a cutting error is sensed by a size sensor near the cutting machine. 
The subnets of the fuzzy Petri net corresponding to Figure 7.7(a), 7.7(b) and 7.7(c) 
are illustrated in Figure 7.8(a), 7.8(b) and 7.8(c). For the sake of simplicity, hollow 
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cylinder is not considered as a soft component at this time. 

In Figure 7.9, we illustrate a Petri net representation of multiple alternative 
transitions for a key operation. Local error recovery is shown using a retry strategy 
here which enables alternate transitions through adjustment of local fuzzy variables. 

t 2 and <3 are considered to be the transitions which accomplish the same subtask. 
A sensing transition is introduced here to identify the token value in p 3 , and the 
on-line selection of the following subsequences will depend on this sensed value. 
Suppose originally, pi contains a token of which the fuzzy value is a'. The local 
fuzzy variable of p, is p,-°\ After t\ is fired, p 3 contains a token with the fuzzy value 
a* = a’ x WF(t x ), and the local fuzzy variable of pj is pj. Transition sense maps 
the local fuzzy variable of the object to a sensing value, /?_,-» . The weighting factor 
of sense is 1. Therefore, <7 J ' = <r j . If 8 l < p 3 > < 0 2 , we will fire for local error 
recovery. If we assume the reasoning functions for local fuzzy variables are the same 
as global fuzzy variables, We may select an a and define 


WFitn = 


1 


s(ti) + a 
The new fuzzy value in pi will be 

1 


, s(ti) = WFtf), 1 < i < 3, a > 0. 


,(°) 


/>!■’ = 


- • wFin ■ p m = < p m 

WF(ttf + c, 1 l> P ‘ WF(t\) + a 


After m times through this loop, 

(m) , WF{t\) ' W (0) ( WF i i l) )m-l (0) < < 

px l WF(t?) + a j P ' ^WF{ti) + a Pl 

Therefore, p\ k \ p\ k ~ l \ . . . , p\ 0) is a strictly decreasing sequence. 

If we divide the p range [0 1 , 8 2 ) to three subranges, [0 1 , 0'), [0\ 9"), and [0", 9 2 ), 
initially, p- 0) € [8",8 2 ). After k x iterations, ) will fall into [8', 9"). We can 
therefore fire t 2 instead of t x and at this time, p\ = ( WF(tj )+a ^ 1 Pi - If after 
iterations for firing t 2 we still cannot recover to a desired correct state, p \ kl+k will 
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Figure 7.8: The subnets of the fuzzy Petri net of error recovery for the peg-cylinder 
assembly example, (a) Planned sequence: (b) When an 

insertion error occurs, and t\$tn subsequence cannot remedy the error, a global 
recovery sequence £2 will be used, (c) When a size error is found, a subsequence t^ts 
will be used to remedy the error. 
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drop down to [6 l ,9') and at that time, 

/ WF{t\) k WF{t £) k (Q) 

Pt K WF{tX) + a ) K WF(t v 2 ) + a ) Pi ' 

Following these iterations, we may succeed in recovery or drop down to the global 

recovery or halt range, [0, 0 1 ). The above strategy, where p decreases with iterative 

tries until it goes through all alternative ME transitions, provides a mechanism to 

implement alternative error recovery. 

More generally, we may define sequences which include transition loops for the 
execution of certain transitions more than once: 

Definition 7.5 Key-transition-loop sequence: A sequence which forms a cycle and 
includes at least one key transition. The number of executions for the loop is 
unknown prior to the execution. 

From the above definition, we know that we cannot decide an actual exe- 
cutable sequence in the off-line planning stage for key-transition-loop sequences. 
Even though during the off-line planning stage, we can enumerate all possible se- 
quences which reflect all possible directions for the ME transitions, this may re- 
quire too much computer storage and time to generate all possible sequences. Even 
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though all sequences are generated, choosing among them also remains a problem 
because we cannot ensure which sequence will be successful at the implementation 
stage. Therefore, we will develop a suitable compact representation for feasible task 
sequences as well as an efficient way to execute them. 

Before we map the system DFPN to an NDFPN for execution, we can gen- 
erate ail feasible, complete sequences which have correct precedence relationships 
for operations. These sequences are expected sequences in the mapped NDFPN. 
When we add ME transitions, the expected sequences are modified to incorporate 
alternative error recovery sequences. We assume actual sequences can be modeled 
as key-transition-loop sequences. 

We generalize each key transition tk to a key transition subsequence Tk because 
sometimes several operations will be needed to accomplish a key task. An expected 
sequence is generated from the corresponding DFPN its: 

E{Sequence ) = S l T l l/ S 2 T 2 u . . . SiT?S i+l . . . T r y S r + x . (7.5) 

We further assume all key transition subsequences are transition loop subsequences. 
Therefore, the executable sequences will become 

Sequence = 5 1 (T, 1 ') + (J S,{T{)+ SiW)+ U U 

. ..Si(Tn*S M . . . (T/) + 5 r+1 . (7.6) 

where x + means executing x one or more than one time. Applying this sequence 
representation to the real-time implementation, when we meet sign in the se- 
quence, further execution will depend on the current state of the system. The system 
may go on executing the sequence, or re-execute the operations represented by the 
transition loop subsequence, or stop executing the remaining part of the sequence. 
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7.5 Error Recovery 

In the previous section, we described an approach to planning and execution 
on the NDFPN with sensory verification. An unverified sensory state initiates either 
a retry of the transition, or an alternative procedure, depending on the values of 
the local fuzzy variables which occur. These procedures involving one transition 
(perhaps one composite transition) are viewed as local error recovery procedures 
since they do not involve other key transitions or places in the net. 

In the more general case, error detection may occur as part of a long sequence of 
events within the plan, and the global error recovery may require either backtracking 
and restart of the sequence, or selection of an alternative error recovery sequence. 
In this section, we develop the formal definition of these strategies based on an 
assumption of bidirectional, or brother, transitions which follow from the AND/OR 
model of the original task. Two cases are considered. In the first case, there is 
only one soft component in the net, and the retry of that sequence depends only 
on returning to a known prior state where the process can be reinitiailized. In 
the second case, there is more than one soft component and the retry becomes 
more complicated since the intermediate states of other soft components must be 
considered in the reexecution. 

Alternative error recovery in the global case follows also from these definitions, 
but is more difficult to generalize completely. The backtracking component of al- 
ternative error recovery is identical to retry, but the execution of the alternative 
sequence cannot be predicted since, in general, it depends on the intermediate val- 
ues of all of the soft components as they were left after the backtracking procedure. 
While access to the alternative procedure can be guaranteed by the methods defined 
below, the success of the alternative procedure is not necessarily predictable since 
the initial state is unknown prior to execution. This situation leads to an emphasis 
on the design of the alternative sequence to properly account for the occurrence of 
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a range of potential initial error states at the branch point. In a broad sense, this 
approach leads to the development of design criteria for the alternative sequences 
which would emphasize the independence of soft components between the alterna- 
tives. This independence constraint would minimize the interaction between error 
states of soft components in the primary sequence and new states in the alternative 
sequence. 

7.5.1 Error Recovery for One Soft Component 

Definition 7.6 Brother transitions: When we map an AND/OR net to an ordinary 
Petri net, each reversible arc will be decomposed into two transitions which are in 
the opposite directions. We define these as brother transitions, ti and t{. 

Lemma 7.1 For any two markings m 1 and m 2 in an ordinary Petri net, which is 
mapped from an AND/OR net, m 2 — ► m l if m 1 — ► m 2 . 

Proof: Suppose m 1 = ( m\,m \ , . . . , m* ), and m 2 — (m 2 , m\, . . . , m 2 ). 

(1) Suppose the arc in the AND/OR net is an 1ST arc, because m 1 — + m 2 , we 
obtain 

m) = m 2 , 1 < j < n, j ^ ji, j ^ m) x = 1, m) 2 = 0, m 2 = 0, m 2 2 = 1. 

i.e., t, moves one token in p ;i to p n . Therefore t, will move the token in p J2 back to 
p n , which can be represented as m 2 m l . 

(2) Suppose the arc in the AND/OR net is an AND arc, because m 1 m 2 , 
we obtain 


m) = m 2 , 1 < j < n , j ± j u j ^ ji , . . . ,j # jk,j ± jk+i- 


and 


m h m n 


= ... — m 


jk 


= ^ m Ui = 0; and m ?i = m l = ■■■ = m jk = °* m Li = l ’ 
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or 

m n = m i = --- = m) k =0, m) k+x = 1; andm) x = m) 7 = . . . = m) k = 1, m 2 k+x = 0. 

i.e., t{ delete the tokens in pj, , p J2 , . . Pj k , and add one token in p Jt+l , or, delete 
the token in Pj k+l and add one token in Pj, , pj 2 , p Jik , respectively. Therefore ti 
will delete the token in Pj k+l and add one token in pj, , p J2 , . . pj k , respectively, or, 
ti will delete the tokens in p ;i , p J2 , . . pj k and add one token in p JJi+1 , which can be 
represented as m 2 A m 1 . 

Q.E.D. □ 

Definition 7.7 Brother sequence: If a sequence 5 is t x t 2 . . .ti, the brother sequence 
of S, which is written as S , is t/_i . . . i\. 

Theorem 7.1 For any two markings m 1 and m 2 in a reversible ordinary Petri net, 
which is mapped from an AND/OR net, m 2 —> m 1 if m 1 m 2 , where S is a 
transition sequence of tit? . . .ti, l > 1. 

Proof: Using the mathematical deduction method: 

1. If / = 1, using Lemma 7.1, we conclude that the theorem is correct. 

2. Suppose when / = k and if the marking m 2 is reachable from m l by firing 
S = 1 1<2 . ■ . <it, then m 1 is reachable from m 2 by S' = tk tfc-i . . . t\. 

3. When / = k + 1, the marking m 2 is reachable from m 1 by firing S' = 
M 2 • • • Mfc+i- We assume the marking m' is reachable when we fire M 2 ■ ■ - tk from 
the marking m 1 , and m 2 is reachable from m' by firing tjfc+i- We know from Lemma 
7.1, m' is also reachable by firing ik+i from the marking m 2 . And again using the 
above supposition, m 1 is reachable from m! by firing tk Mi . . .fj. Therefore, m 1 is 
reachable from m 2 by firing Mi M • ■ * 1 = <^ 7 - 

We conclude that the initial marking is reachable by the brother sequence 
from the final marking, which is reachable by the original sequence from the initial 
marking. 
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s.v. 

Figure 7.10: An example of NDFPN with ME transitions. 

Q.E.D. □ 

As a mechanism to initiate error recovery, we add a sensing transition, for 
which the weighting factor of the reasoning function for the local fuzzy variable is a 
random value. An example of an NDFPN with ME transitions is shown in Figure 
7.10. In this example, the key transition t" remains a constant transition. Place p 2 
will therefore receive an expected fuzzy token after t v is fired and the local fuzzy 
variable in p 2 is fixed. We then fire the s.v . (sensor verification) transition, which 
is assumed to be a random transition, to verify the real local state of p 2 . The new 
local fuzzy value of the object represented by p 2 is thus dependent on the current 
weighting factor of the transition s.v. The following execution of sequences through 
ME transitions will depend on the current local fuzzy value associated with p 2 . If 
the state is acceptable, the originally planned sequence continues to execute. If the 
state is not satisfied but may still be reached after some modification is made, we 
fire t v ' and fire the s.v. transition once more. If an error, which cannot be recovered 
locally, is detected, we may go back to the initial state and replace the corresponding 
soft component. 

The following theorem reasons about the recovery sequence from the original 
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task sequence. A definition and a lemma are shown first to introduce some notation. 
Definition 7.8 Token defuzzifying function Q, p (S g ): 


n„((<7‘,<r 2 = <tf). 


where 



if a' ± e, 
otherwise, 


1 < i < n. 


Definition 7.9 Transition defuzzifying function fl t (7v): 


(7.7) 


n,((WF u WF, WF m )) = ( 1,1 1 ) . 


(7.8) 


Lemma 7.2 If S° S g , then f l p (5®) —> fi p (5*) when r a = where “=” 

means “is assigned the value of” . 


Proof: Suppose S = M 2 ...$*• Since the weighting factors for all reasoning rules 
for token values are defuzzified as r a = fl t (Tv), from S® S g , 5° = Q^S®) and 
WF\ = 1, we obtain S g = Q p (S g ). Using the mathematical deduction method, we 
can obtain S' g = fl p (5‘). where 1 < i < k. Therefore, S g = Q, p (S g ). We conclude 
that fi p (SJ) 4 n„(5‘). 

Q.E.D. □ 

Theorem 7.2 If S g) where S 1 = Sxt'ftlS-it'ffi . . .Sitf, then Q p (5’*) ^ fi p (S°) 
when = fit(7v), where <S 2 = tf St 1 . . .^2 hi- 
proof: Since 5° S g , r a = Q t (r ff ) and according to Lemma 7.2, we get fl p (S®) 
fl p (S g ), where S 1 = SititfSitfiZ . ..Sitf. Using Theorem 7.1, we obtain Q p (5*) 
fi p (5°), where 

5 1 = SiMfiSaMf •••£/*!' = if Sitf-xifTx ...tffi S[. 
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Using Lemma 7.1, 

n p(S' +1 ) £ n,(sj) <=> n,(5}) £ n,(S' +1 ), 

therefore, 

n,(sj) ^ n,(sj), i < ; < i - 1 . 

We can delete all pairs of tfVf and the sequences of states the system will follow 
will not be altered. Therefore, we conclude that ft p (Sg) —* fl p (5®), where S 2 = 

7 ... 37. 

Q.E.D. □ 

The following algorithm states the procedure discussed so far. We may observe 
that when we follow the global recovery sequence to replace the incorrect soft com- 
ponent, we need not go back to the initial state. The replacement can be performed 
just before the first key transition corresponding to this soft component. The sixth 
step of the following algorithm implements this observation. 

Algorithm 7.1 Execution of a Task Sequence with Sensory Verification and Error 
Recovery (One Soft Component) 

Input: The correct task sequence set and one element S = Sxt^txS^t 1 ^ . • .t^t^S 3 +\, 
from this set, where t\ , *$, . . . , t" are s key transitions on the soft objects, the 
initial global fuzzy state 5°, and the DFPN from which S is generated. 

Output: None. 

By-product: The expected task is efficiently executed, or recovers to the initial state 
should an unrecoverable error occur. 

1. Add sensory verification transition s.v.i and one or more t\ to each key transition 
t V as shown in Figure 7.10. Set the weighting factor of r a for each new tf and 
s.v.i as 1. M = 0. 
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2. Execute the next transition in the sequence until we meet a key transition V-, 

fire it, and go to 4. 

3. If we reach the end of the sequence, exit. 

4 . Fire the sensory verification transition s.u.,-, get the token of new local fuzzy 

variable pj in output place pj. 

5. If pj € [0,0]) and M reaches an upper bound, fire tf ^ ^17- • - notify the 

high level controller and exit. 

6. If pj € [0,0]), and there is no alternative global sequence, or, all alternative 

global sequences have been tried, WF(tf) = 1 /ni=i Ft, fire Si <5,_i . . . 37 
M = M + 1, WF(if) = 1, go to 2. 

7. If pj € [0,0]), and there is a next alternative global sequence, WF(tf) = 
1/nU Ft, fire Tf 3^ S{-\ . . ."SI, M = M+ 1, WF(tf) = 1, choose the alternative 
sequence and go to 2. 

8. If pj € [0],0]), an< i ^ f° r this key operation, there is no alternative transition, 

fire t 1 -' and go to 4, else, go to 10. 

9. Otherwise, go to 2. 

10. Choose an alternative transition for this key operation to fire, and then go to 
4. 


7.5.2 Error Recovery for Multiple Soft Components 

Multiple soft components are often present in a robotic workcell. A fuzzy 
marking and representation strategy for multiple soft components during different 
stages of operations such as assembly, disassembly, and 1ST, has been discussed in 
[12, 20]. In this subsection, we show how one of the soft components recovers from 
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an intermediate fuzzy state, if error conditions are detected for this component or a 
subassembly which contains this component. The method for execution of the task 
sequence with sensory verification and error recovery for this case is the same as the 
single soft component case discussed in the last subsection. 

For a system which contains one soft component, when the system recovers 
from errors back to the initial state and the component is replaced by a new com- 
ponent or repaired, the original task sequence could be re-executed without any 
modification. For a system which contains multiple soft components, when the sys- 
tem goes back to the initial state and one soft component is replaced, the states 
of other soft components are in their intermediate fuzzy states. If we re-execute 
the same task sequence which was planned originally, we are expected to reach 
another failure state. To solve this problem, we may add a sensory identification 
procedure before each key transition. In the following theorem, we propose an al- 
ternative method to automatically modify the original task sequence after one error 
component is repaired or replaced. 

Definition 7.10 Sequence masking operation A set of transitions A = {^i , ^ 2 ? 
. . . , t n } are deleted from a sequence of transitions, <5, i.e., we assume 5 = SitiSit 2 • • • 
ticSk+i, where Si is a subsequence of 0 or more transitions which does not contain 
tj, l < i < k + l, 1 < j < n. Therefore, 

S — A = S\t\Slti . . . tkSk+l — {^ 1 , ^ 2 ) • • • Tn} = ■ • • $k+l, 1 < k < n. (7.9) 

Definition 7.11 Sequence concatenation operation Suppose 

S\ = t\ti . . . t r , S 2 — t r +\t r +2 ■ • ■ tni 

then 

Si + <$2 = ^1^2 • • • t r + f r + if r +2 • • • ffl = ^1^2 • • • trfr+l^r+2 • • • ( * TO) 
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Definition 7.12 Brother transition set: Given a transition set A, A = {< 1 , < 2 . • • 
its brother transition set, which is denoted by A, is A = {t\,t 2 , . . . ,t n }, where t, is 
the brother transition of l < i < n. 

Definition 7.13 Complete transition set A c ; Given a transition setA = •• -.G}, 

its corresponding complete transition set A c = A U A = {<i, t\, t 2 , t 2 , . . . , t n , t n }. 

Theorem 7.3 If <5 = t l t 2 ...t n , A c = {<i, t x , t 2 , t 2 ,..., t„ f ,} , then 

<5 - A c - 5 - A c . (7.11) 

Proof: (1) If V A c , then t' £ A c , for 1 < i < n. Because if we assume t' € A c , 
then t' = tj or t' = t : , both of which will lead to a contradiction that V € A c . 
Therefore, 

5- A c = S = S - A c . 

(2) If there exists at least one transition of t' which belongs to A c . For the sake of 
simplicity, we assume {t 1 , t 2 , . . . , t n } f| A c = {V } and V = f,. Then, 

S - A c = Bt 2 . . . ti-Hiti* 1 ...t n - A c - tH 2 . . . p-H** 1 777F 

= F t n ~ l . . .tJ+i tf-i . . .F = F f n_1 . . v U-* . . - A c 

= Ot 2 . . ...< n — A c = — A c . 

Q.E.D. □ 

Theorem 7.4 If S* , <S = and when 5 is executed, it stops at 

1 < i < Jt. Then, after error recovery to the initial state and the jth soft component 
is repaired or replaced, the resumption to the intermediate state where the failure 
happens, is guaranteed, if the task sequence from the initial state after recovery is 
modified as 

S' = f V . . . e - ( a; u AS u ■ ■ ■ U U U-U^) + •••«*. (t.h) 
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where A p represents the set of feasible key transitions for the pth soft component, 
1 < p < r. 

Proof: Since -4 5*, and S = t l t 2 . . .t ' . . . t k , which stops at t\ according to 
Theorem 7.2, the recovery sequence is then S r = t' Si Si- 1 . . S\, where 

3J3CT...^3i-?= T i^...?r-(A;UaiU-UaS-,UasUa5*,U-U^)- 


When we reach the initial state, we don’t fire any key transition, therefore, the 
fuzzy state for each soft object does not change. After we replace the jth soft 
component which is not processed, we should process it to its desired intermediate 
state. Therefore, the subset of the key transition set for jth soft component is refired 
and the modified sequence is 


5' = ?FrFi...F-(AsUA5U'--U^>-.U^ + .U--U A « + « i+lii+ ’-- i 

= - (a; U as U • • • U a, c -, U A' + , U ■ ■ • U A :> + 

= ( V . . . - ( a; u a; U ■ ■ • U a;-, U A‘„ U • • • U a;) + < i+ v« 

Q.E.D. □ 


7.6 An Algorithm for Generating an Executable fuzzy Petri Net 

We have already discussed the basic theory of reasoning in a fuzzy Petri net 
and its application in error detection and recovery. After the planning stage, we 
may get a ‘script’ of operations sequences for execution and when an error occurs, 
we may refer to the net representation and automatically find a recovery sequence to 
get back to a previous state, and then follow a possibly modified sequence to recover 
to the interrupting state. Sometimes because of the high probability of errors during 
the implementation of a sequence, we are required to create an executable fuzzy Petri 
net , so that more flexibility of alternative operations sequences and robust on-line 
selection of enabling transitions can be incorporated. In this approach, the same 
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fuzzy reasoning rules for r p can be created with appropriate weighting factors. The 
first step for creating an executable fuzzy Petri net is to find a feasible, complete, 
and correctly ordered sequence from the original system fuzzy Petri net. The next 
step is described by an algorithm shown below. 

Algorithm 7.2 Generation of an executable fuzzy Petri net for implementation of 
a robotic tasi t(We assume for this discussion that one soft component exists in the 
system, but this can be generalized.) 

Input: A fuzzy Petri net generated from an AND/OR net for the system, a feasible, 
complete, and correctly ordered task sequence, t\t 2 . . . t n , searched from the net. 
Output: An executable fuzzy Petri net. 

1. Suppose (i) all weighting factors of r p for key transitions are WF\, WF 2 , . . . , WF r ‘, 

(ii) all thresholds(ranges of real numbers) for m transitions in the system 
are 9\, 0 2 , 0 m ; (iii) ..., ti T are key transitions in the sequence, 

i\ < h < ... < i r ; (iv) Let L be the initial token value of the soft object (if 
r — 0, then L = 1.0). M = 0. Initl = 1. Init2 = L. H = 1.0 if r = 0, 
otherwise, H is assigned an integer. 

2. M = M + 1. If M < r, go to 5. 

3. For all tj , Initl < j < n, 9j = [Init2, H). 

4- For any transition tj which has no threshold, if its brother transition tj has 
threshold 5, assign 9 to tj , otherwise, assign [ L,H ) to t } . Exit. 

5. For all tj, Initl < j < ifj, 9j = [Init2, Init2 x WFm). 

6. Initl = i\f + 1. Init2 = Init2 x WF\f. Go to 2. 

In real-time execution of the operations sequence on the executable fuzzy Petri 
net, we need to model sensor and sensing operations in the net to handle uncertainty. 
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After sensing transitions are added to the net, the outcome on-line local fuzzy values 
depend on the detected sensor value mapping, i.e., r*'(S,), where r* 1 is a sensing 
mapping function, and Si is a sensed value. 

Two types of sensing are used in the fuzzy Petri net. One is called discrete 
sensing , and the other is called continuous sensing. Discrete sensing indicates that 
r* and r' p (Si) take on discrete values, while continuous sensing means that r' p and 
r‘ p (Si) take on continuous values. After we obtain an executable fuzzy Petri net 
using the above algorithm, we add sensing transitions near some key transitions 
and after each key transition is fired, we fire the sensing transition, and let the local 
fuzzy variables of the sensing output decide the following enabled transitions. Then, 
given the initial state, a sequence will be automatically followed to reach the final 
state and perform error recovery operations or subsequences if necessary. 

A simplified version of the peg-cylinder assembly system(without robot), its 
executable fuzzy Petri net, and the net with discrete sensing and continuous sensing 
added, are shown in Figure 7.11. In Figure 7.11(b), cut, lubricate, and insert(or 
followed by several loops of remove, insert) is the only feasible, complete, and correct 
sequence found on-line. In Figure 7.11(c), after the ‘cut sensing’ transition is added, 
we assume ‘cut’ transition having a weighting factor of 1 and ‘cut sensing’ transition 
having a continuous sensing value 1 < WF(Si) < 2. Depending on this value, a 
repeated trial error recovery may be necessary if the peg is not cut to the right size. 
For the ‘insertion sensing’ transition, if the insertion operation succeeds, a final 
state will be reached that no transition is enabled anymore. Otherwise, a ‘remove’ 
transition may be fired to invoke a global error recovery subsequence. 

7.7 Examples 

In this section, we show two examples, one of which is oriented to alternative 
local error recovery, and the other to alternative global error recovery. \V hen a 
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(c) 

Figure 7.11: An example for the executable fuzzy Petri net. (a) Petri net example for 
peg-cylinder assembly system(without robot), (b) The executable fuzzy Petri net(no 
sensors), (c) The net with discrete sensor(global error recovery) and continuous 
sensors( repeated trial error recovery). 
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matching 

Figure 7.12: An error recovery mechanism for t$ in Figure 7.1. 

local recovery procedure fails to recover the error after a finite number of retries, a 
backtracking path will be automatically followed to an earlier stage of the task or 
the initial state, then, the original sequence will be executed again, or, an alternative 
sequence will be called to replace the original one. 

7.7.1 Example of Alternative Local Error Recovery 

In this subsection, we show sensor-based alternative error recovery for the 
example shown in Figure 7.1, where a fuzzy Petri net representation is illustrated. 
As we see from Figure 7.1, t$ is a key transition with a weighting factor 2. Based 
on the algorithm for execution of task sequence with sensory verification and error 
recovery , we add an s.v. matching transition, and cml, cm2 transitions for local 
error recovery, cml corresponds to the first cutting machine and cm2 corresponds 
to the second cutting machine. The modified partial fuzzy Petri net is shown in 
Figure 7.12. Notice that it’s not necessary to add a special transition for decreasing 
p because in this case, each unsuccessful matching will automatically decrease the 
fuzzy value. 

Initially, the prime token value <r 10 = 0.1, WFs = 2, a 12 = 2 x 0.1 = 0.2, and 
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the local fuzzy variable p X2 = a 12 . The three ranges [0,0*), [0 1 ,# 2 ) and (0 2 ,0 3 ] £re 
[0, 0.12), [0.12, 0.18), [0.18, 0.2], respectively, for p X2 in p X2 ■ [0\ 0 2 ) is divided into two 
subranges, [0.12,0.15) and [0.15,0.18), so that the alternative error recovery with 
two cutting machines can be implemented. For transition f 19 , r£ 19 is represented as 

p x2 w = Pu x W-F19 x (1 — match ) + match x W F x 9 x 0.2, 

match = 1 if WF X9 > 0.94, otherwise, match = 0. Moreover, WF 20 = WF 2 1 = 1. 
We list three possible cases of derivations of sequences as follows: 

Case 1: The weighting factor of random transition, matching , is WF X9 = 0.95. 
Thus, pi 2 = 0.2 x 0.95 = 0.19 € (0 2 ,0 3 ] and the sequence succeeds at this point. 

Case 2. WF X9 = 0.85, p u = 0.2 x 0.85 = 0.17 € [9\0 2 ). cml will be 
fired(cutting machine 1 is used again) and p x2 = 0.17. If again, WF\ 9 = 0.85, 
Pu — 0.1445 € [0.12,0.15). cm2 is fired at this time and we suppose WF X9 now 
becomes 0.98. Correspondingly, p X2 — 0 + 0.98 x 0.2 = 0.196, therefore, the local 
error recovery succeeds in this case. 

Case 3. At the last step of the above case, if we assume WF X9 is still 0.85. 
Correspondingly, p x2 = 0.85 x 0.1445 = 0.1226. cm2 is fired again and we suppose 
WF X9 is still 0.85, then p X2 = 0.1042 6 [0,0.12). Therefore, a global error recovery 
back to the initial state is necessary and the peg should be replaced. 

7.7.2 Example of Alternative Global Error Recovery 

Suppose we have three blocks, A, B, and C . The robot is required to assemble 
these blocks and the final configuration for this task is shown in Figure 7.13(a). The 
AND/OR net representation of all feasible components, A, B , and C , all feasible 
subassemblies, AB, BC, and AC, and the assembly, ABC , and their geometric 
relations, are illustrated in Figure 7.13(b). For the sake of simplicity and symmetry, 
we assume the assembly task should start from putting A on the platform first. 
Of course, more complicated cases could also be considered and the generalities of 
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Figure 7.13: (a) The final configuration of the assembly of blocks A, B, and C. (b) 
The AND/OR net representation of this assembly task. 


the following discussion will not be lost. Using the mapping algorithm, we obtain 
a corresponding Petri net. Figure 7.14 shows a subnet of this Petri net which 
does not include subassembly BC and the related transitions. In this net, t 6 is a 
nondeterministic transition in the sense that we don’t know whether the assembly 
operation of AC and B could be accomplished successfully because of the imprecise 
distance between A and C when AC is obtained. 

We may consider AC as a soft object and the distance between A and C in the 
subassembly AC as a soft parameter. We also consider t& as a random transition 
with a weighting factor WF(to). The local fuzzy values for AC and ABC are p, 4 c 
and pabc, respectively, and the firing rule r p for t 6 is 


Pabc = Pac x WFq x (1 — match) + match x 1VF 6 x 1, 

where match = 1 if WF 6 > 0.98, otherwise, match = 0. All other transitions in the 
net are deterministic and having weighting factors of 1. The firing rules of these 
transitions are the same as shown in (7.1), (7.2) and (7.3). 

There are four possible task sequences for this example, i.e., t 2 t 7 , t 3 t 6 , t 2 tit 3 t 6 
and t 3 t 4 t 2 t 7 . Suppose we choose t 3 f 6 to execute. If the distance between A and C 
is too small to fit B inside them, t 6 ts will be fired several times. If the random 
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Figure 7. 14: The subnet of the Petri net representation of the example of assembling 
A , B and C . 

weighting factor for t 6 is below 0.98 for several consecutive times, the local fuzzy 
value in AC will strictly decrease and eventually force a global error recovery of 
this sequence, i.e., t 4 will be fired and AC decomposed. Then, either an alternative 
planned task sequence, * 2 * 7 , or, the originally chosen sequence, *3*6, is reexecuted. 
In the latter case, C is reassembled with A and the distance between A and C at 
this time may be adjusted and the sequence may be successful. Otherwise, if several 
trials of the sequence are performed and it still fails, an alternative task sequence 
will be forced to execute in place of the original one by the system supervisor. 
Figure 7.15 visually shows the error recovery procedures discussed above. A partial 
executable fuzzy Petri net, with continuous sensing for assembling AC and discrete 
sensing for assembling ABC, are shown in Figure 7.16. Because there is no soft 
component existing in the system, we assign [1,2) to each transition and the initial 
tokens are all 1 based on the algorithm shown in Section 7.6. 
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Figure 7.15: The possible errors and the corresponding recovery procedures for the 
task to assemble A, B , and C. (a) Put A. (b) Put C. (c) Put B between A and C 
and fails, (d) Same as (c). (e) Same as (c). (f) Remove B. (g) Remove C. (h) Put 
C, possibly with distance adjusted, (i) Follow an alternative sequence and put B. 
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7.8 Conclusion 

In this chapter, we introduce a novel sensor-based error recovery strategy based 
on the fuzzy Petri net representation of robotic workcells and the fuzzy property 
of sensory verification. Fuzzy Petri nets are used to model fuzzy process state, 
including uncertainty of local parameters and a global fuzzy variable associated with 
‘degree of completion’. Using fuzzy Petri nets, we can enforce required precedence 
of operations for a set of ‘key’ operations, and represent ‘soft objects which have 
changing properties or internal states. 

We have shown in this chapter an approach to implementation of embedded 
error recovery strategies which change the precedence of operations by sensing fuzzy 
values. The fuzzy information propagates and resequences operations to accomplish 
task goals. When the expected information is obtained, the sequence will not be 
altered. However, when an error is detected, the local recovery loop or the global 
recovery path will be followed to guarantee that correct fuzzy degrees of completion 
of soft objects are reached. After the global recovery is finished, different sequences 
for re-execution are proposed for the case of a single soft component, and that of 
multiple soft components, respectively. Fuzzy values discussed in this chapter are 
important for searching in the planning stage as well as for sensing, verification, 
detection, and reasoning about sensory conditions in the execution stage. 

Future directions of this work will concentrate on the applications of the theo- 
ries proposed in this chapter to more generalized robotic systems and on the decom- 
position of high level task sequences into lower level motion and execution sequences, 
so that a hierarchical error detection and recovery mechanism may be incorporated. 
Sensor-based control and sensor-based verification and error recovery can be inte- 
grated, and sensor resources can be coordinated in the whole robotic system. Such 
a sensor-based robotic control workcell would be more flexible, adaptive, and fault- 
tolerant and would reduce the effort required for implementation of new tasks. 



CHAPTER 8 
CONCLUSIONS 


8.1 Summary 

The principal contribution of this thesis is to task sequence representation, 
planning, and error recovery for robotic systems. Both plan generation and plan 
execution are modeled by Petri nets and fuzzy Petri nets, which provide an efficient 
methodology to simulate and analyze the properties of the systems. The fuzzy 
Petri net is shown to be a promising tool to incorporate uncertainty into the system 
model. This treatment of modeling uncertainty using the fuzzy Petri net and its 
applications to robot task planning and sensor-based error recovery has provided a 
framework for analysis and design in many problem areas. The work presented in 
this thesis should also stimulate further interest and research in this direction. 

Using the methodology and theory presented in this thesis, we are able to rep- 
resent, plan, and execute feasible operations sequences for a specific robotic task. 
The input to our planner is the descriptions of the components and geometric re- 
lations among components, feasible operations, initial and final system states, and 
the working environment. We could use this information to build up a system rep- 
resentation for robotic task sequences. This model is then mapped to a Petri net, 
which will be decomposed to lower level representations based on the specifications 
of the execution-level devices. On any level of decomposition, we may search one 
or more feasible sequences and may want to analyze the properties of the system 
including safeness, liveness, and reversibility. After fuzzy Petri nets are introduced 
to represent uncertainty and incompleteness with the system model, we are able to 
reduce the search space for sequences in the Petri net model by marking subgoals 
using global fuzzy variables, and we can monitor the degree of completion during 
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the planning process for verifying and pruning infeasible partial sequences. 

One major approach in this work is that three kinds of fuzzy variables are 
incorporated in the fuzzy Petri net model and the reasoning mechanisms and fuzzy 
state representation could be built into the fuzzy Petri net. A local fuzzy variable 
is used to characterize lower level mechanical and geometric parameters of a device 
or object in the robotic system, a fuzzy marking variable is introduced to denote 
the uncertainty that an event occurs, and a global fuzzy variable characterizes the 
degree of completion for a global task. In particular, fuzzy reasoning rules for three 
kinds of operations, assembly, disassembly, and 1ST operations derived from the 
robot assembly system, are developed to reason about the global fuzzy variables. 
Mutually exclusive transitions are used to select and reason about the execution of 
robotic actions on-line based on both local and global fuzzy variables. Different error 
recovery strategies including retrying error recovery, local alternative error recovery, 
and global alternative error recovery are shown to be efficient and reliable to execute 
a task sequence under uncertainty. 

Some basic cases of fuzzy Petri nets are analyzed based on local fuzzy variables 
and fuzzy marking variables. In analyzing the case of transition firing depending on 
input local fuzzy variables, a subclass of the case was found to satisfy the liveness, 
safeness, and reversibility under a set of conditions. One advantage of using local 
fuzzy variables to represent the state of execution-level devices including the robot 
is that the theory of fuzzy sets and fuzzy mathematical operations can be directly 
used to compute and analyze the uncertainty using fuzzy numbers. 

In this research, the efficient, reliable, and robust planning and execution of 
robotic task sequences are guaranteed through the hierarchical task decomposition 
and implementation of error recovery strategies incorporated in the Petri net. Our 
results represented in this thesis provide a novel methodology and applications of 
robot task planning with uncertainty. 


206 


8.2 Future Work 

A number of research directions deserve further consideration beyond the re- 
sults presented in this thesis. 

• The selection and evaluation of all feasible task sequences based on the AND/OR 
net and Petri net representation of task sequence plans is an important exten- 
sion to the work done here in task sequence planning. In particular, for the 
selection and execution of parallel operations during the planning process one 
needs to analyze all feasible enabled transitions in terms of resource conflicts 
and other factors including timing, cost, flexibility, and reliability. Another 
possibility is to execute in parallel an error recovery sequence and some op- 
erations in the original sequence when the error is independent with these 
operations. Analysis of uncertainty with parallel execution of operations also 
needs to be performed. 

• The synthesis of planning strategies under uncertainty within a generic hierar- 
chical structure for decomposition may be used to handle errors which appear 
during the decomposition of a task sequence towards the final net. For exam- 
ple, the working environment of the execution of the sequence may be changed 
not by sensing and manipulation, but by other random factors. Thus, a sen- 
sory verification procedure might be necessary to check some unsafe substate 
before the substate is processed by the current operation. 

• A planning for planning problem may be important to ensure the property 
of reversibility of the final net during decomposition. Sometimes, we need to 
recover from an error to the initial state while retaining some lower level plans 
for future refiring and discarding of others. The coordination and scheduling 
for processing these plans are incorporated into the recovery procedure. When 
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a sequence is reinitiated from the initial state, we should guarantee state reser- 
vation for those waiting components and execution of unchanged plans which 
might be verified. 

• More general cases of fuzzy Petri nets and their properties should be explored 
and analyzed when fuzzy Petri nets are used to model more complex systems. 
It might be useful to look at the interrelationships among the three kinds 
of fuzzy variables during fuzzy reasoning by rules. More detailed lower level 
representation and integration of these three variables are needed to expose 
the necessity to use them in modeling uncertainty. Other forms of non-fuzzy 
probabilistic reasoning could also be incorporated within this framework. 

• The design of reasoning structures within Petri nets is another important 
issue to design a fuzzy Petri net. Many learning techniques can be explored 
to generate a rule base. Neural networks provide a good method to represent 
and train these rules. The mapping from real sensory data to fuzzy numbers 
for reasoning in the fuzzy Petri net is also an interesting topic. 

• Fuzzy Petri nets proposed in this thesis should be applied to modeling, anal- 
ysis, and simulations of other related areas such as knowledge representation, 
knowledge reasoning, design of expert systems, discrete event systems, flexi- 
ble manufacturing systems, scheduling, and other kinds of applications which 
need to handle uncertainty. The feedback from applications and implementa- 
tion may bring revisions and enhancements to the theory of fuzzy Petri net 
initiated in this thesis. 
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